-- Logs begin at Wed 2022-08-24 06:03:00 UTC, end at Wed 2022-08-24 07:03:03 UTC. -- Aug 24 06:34:45.857174 dv-cinder-854271-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:34:45.868465 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:34:45 2022] *** Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: nodename: dv-cinder-854271-1-iscsi Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: machine: x86_64 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: clock source: unix Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: pcre jit disabled Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: detected number of CPU cores: 4 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: current working directory: / Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: your processes number limit is 47680 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: your memory page size is 4096 bytes Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: detected max file descriptor number: 2048 Aug 24 06:34:45.872026 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: lock engine: pthread robust mutexes Aug 24 06:34:45.873013 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: thunder lock: enabled Aug 24 06:34:45.873013 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:34:45.873013 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:34:45.912553 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: Python main interpreter initialized at 0x5562a913e9c0 Aug 24 06:34:45.912553 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: python threads support enabled Aug 24 06:34:45.912553 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: your server socket listen backlog is limited to 100 connections Aug 24 06:34:45.912553 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:34:45.912919 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:34:45.912919 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: *** Operational MODE: preforking *** Aug 24 06:34:45.913216 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:34:45.913216 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: spawned uWSGI master process (pid: 112305) Aug 24 06:34:45.913419 dv-cinder-854271-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:34:45.913913 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: spawned uWSGI worker 1 (pid: 112306, cores: 1) Aug 24 06:34:45.914846 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: spawned uWSGI worker 2 (pid: 112307, cores: 1) Aug 24 06:34:45.914846 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:34:46.574970 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:34:46.596311 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:34:47.658712 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:34:47.658712 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: from cryptography.utils import int_from_bytes Aug 24 06:34:47.659540 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:34:47.659540 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: from cryptography.utils import int_from_bytes Aug 24 06:34:47.662338 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:34:47.662338 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: from cryptography.utils import int_from_bytes Aug 24 06:34:47.662803 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:34:47.662803 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: from cryptography.utils import int_from_bytes Aug 24 06:34:50.138091 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:34:50.138817 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:34:50.138817 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:34:50.139218 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:34:50.139471 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:34:50.139838 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.140160 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.140470 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.140786 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.141213 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.141517 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.141917 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.142232 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.142553 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.142811 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.143120 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.143463 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-1-iscsi {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.143778 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.144084 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.144383 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.144695 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.144993 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.145308 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.145609 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.146092 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.146817 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.147120 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.147465 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.147787 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.148096 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.148399 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.148713 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.149014 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.149331 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.149634 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.150021 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-1-iscsi {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.150335 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.150640 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.150948 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.151377 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.151687 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.151992 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.152304 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.152562 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:34:50.152957 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.153060 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:34:50.153153 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.153236 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.153324 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:34:50.153501 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.153675 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:34:50.153812 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.153932 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:34:50.154129 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.154316 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.154414 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.154643 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.154740 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.154963 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155058 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155305 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155416 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155636 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155741 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.155942 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156041 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156182 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156278 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156470 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156590 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.156865 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157205 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157384 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157522 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157613 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157771 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.157891 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158017 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158219 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-1-iscsi {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158323 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158542 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158631 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158847 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.158937 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159154 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159266 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159492 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159609 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159794 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.159891 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160092 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160207 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160392 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160494 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160691 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160888 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.160991 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161195 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161292 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161497 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161586 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161804 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.161901 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162138 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162244 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162447 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162543 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162755 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.162850 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163068 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163390 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163480 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163706 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.163791 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164017 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164119 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164315 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164410 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-1-iscsi {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164627 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164731 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.164939 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165035 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165242 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165338 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165541 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165692 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.165840 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166002 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166153 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166311 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166479 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166628 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166775 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.166944 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167032 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167285 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167586 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167586 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167749 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167907 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.167997 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168207 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168312 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168506 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168594 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168797 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.168885 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169087 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169175 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169385 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169473 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169684 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169773 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.169979 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170075 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170275 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170418 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170508 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170588 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170810 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.170907 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171128 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171231 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171455 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171578 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171755 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.171845 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.172017 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.172104 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.172416 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.172522 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.172716 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173016 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173137 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173315 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173469 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173614 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173785 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.173933 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174100 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174232 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174409 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174531 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174721 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.174842 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175041 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175137 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175376 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175479 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175685 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175781 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.175991 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176079 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176307 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176404 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176612 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176700 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176905 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.176991 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177204 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177292 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177510 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177607 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177809 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.177906 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178106 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178196 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178402 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178490 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178698 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178786 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.178993 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179082 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179318 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179410 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179615 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179717 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179911 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.179999 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180203 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180290 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180511 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180607 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180824 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.180912 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181127 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181221 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181428 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181528 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181729 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181818 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.181976 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.182068 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.182278 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.182445 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.182581 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.182675 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.182897 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.182997 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.183322 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.183529 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.183626 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.183708 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.183820 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.183937 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.184251 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.184406 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.184557 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.184725 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.184866 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.185035 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.185185 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.185340 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.185491 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.185647 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.185796 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.185953 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.186103 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.186257 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.186418 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.186562 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.186732 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.186867 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.187056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.187168 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.187397 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.187512 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.187708 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.187891 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.188076 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.188383 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.188699 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.188798 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.189017 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.189119 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.189328 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.189426 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.189634 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.189723 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.189955 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.190050 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.190263 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.190351 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.190574 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.190661 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.190893 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.190991 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.191227 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.191318 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.191524 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.191614 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.191825 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.192287 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.192496 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.192641 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.192802 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.192898 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.193117 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.193212 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.193415 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.193504 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.193720 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.193809 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.194025 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.194112 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.194324 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.194410 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.194625 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.194715 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.194928 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.195023 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.195253 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.195369 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.195556 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.195646 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.195858 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.195947 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.196155 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.196242 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.196454 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.196589 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.196750 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.196840 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.197053 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.197139 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.197361 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.197457 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.197662 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.197750 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.197957 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.198045 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.198254 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.198341 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.198551 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.198638 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:34:50.198855 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.198950 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199153 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199318 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199492 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199589 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199813 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.199908 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200112 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200213 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200438 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200540 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200742 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.200831 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201047 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201149 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201351 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201446 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201658 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201746 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.201958 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202054 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202265 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202358 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202568 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202693 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202870 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.202961 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.203198 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.203285 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.203568 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.203660 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204122 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204246 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204550 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204652 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204854 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.204955 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205158 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205257 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205469 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205557 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205775 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.205873 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206083 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206180 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206393 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206481 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206700 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.206798 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207020 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207109 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207358 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207449 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207670 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207772 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.207998 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208094 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208323 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208452 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208624 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208750 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.208934 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209074 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209254 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209411 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209568 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209703 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209868 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.209984 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210172 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210308 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210474 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210590 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210787 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.210908 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211065 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211254 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211419 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211563 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211681 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.211789 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212053 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212179 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212305 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212415 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212546 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212688 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212843 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.212991 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213160 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213277 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213463 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213577 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.213895 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214066 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214269 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214428 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214553 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214670 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214788 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.214971 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215094 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215306 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215420 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215611 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215740 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.215930 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216050 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216251 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216363 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216552 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216674 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216857 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.216977 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217161 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217275 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217467 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217580 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.217918 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.218073 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.218185 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.218881 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.218977 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219076 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219236 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219324 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219418 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219601 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.219923 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220106 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220282 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220425 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220601 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220735 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.220910 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221041 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221357 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221546 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221695 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.221851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222026 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222174 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222353 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222480 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222670 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222791 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.222980 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223101 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223316 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223440 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223626 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223763 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.223942 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224076 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224260 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224390 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224558 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224708 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.224874 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225042 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225180 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225345 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225497 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225668 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225803 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.225993 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226120 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226308 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226423 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226612 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226738 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.226922 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227020 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227242 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227365 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227546 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227688 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.227849 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228020 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228156 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228326 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228456 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228633 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228758 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.228952 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229044 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229261 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229350 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229566 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229655 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229872 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.229961 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230175 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230270 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230481 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230628 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230766 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.230866 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231076 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231179 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231405 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231504 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231710 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.231807 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232009 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232110 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232322 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232439 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232626 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232727 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.232922 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233024 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233220 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233318 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233527 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233615 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.233846 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234021 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234152 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234241 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234458 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234545 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234801 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.234899 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.235269 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.235571 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.235664 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.235890 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.235980 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236197 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236286 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236496 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236584 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236794 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.236891 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237091 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237183 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237427 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237525 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237733 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.237829 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238119 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238342 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238430 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238659 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238757 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.238963 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239093 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239281 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239371 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239589 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239697 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239892 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.239981 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240207 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240294 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240515 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240612 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240815 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.240902 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241120 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241208 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241425 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241516 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241729 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.241818 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242033 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242130 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242336 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242491 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242634 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242723 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.242942 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243054 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243271 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243389 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243568 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243657 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243874 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.243963 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.244183 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.244271 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.244515 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.244808 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.244910 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245088 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245179 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245399 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245495 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245712 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.245802 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246022 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246110 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246334 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246422 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246638 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246728 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.246944 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247034 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247277 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247374 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247592 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247695 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247897 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.247993 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248197 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248284 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248499 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248586 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248808 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.248903 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249108 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249197 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249411 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249498 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249712 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.249801 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.250021 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.250110 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.250405 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.250502 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.250774 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251077 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251166 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251408 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251501 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251722 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.251821 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252022 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252111 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252329 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252426 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252629 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252727 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.252946 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253035 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253249 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253338 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253549 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253645 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253851 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.253940 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254148 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254236 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254484 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254573 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254784 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.254875 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255102 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255242 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255448 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255539 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255758 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.255846 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256067 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256155 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256369 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256460 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256672 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256768 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.256975 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257070 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257275 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257364 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257574 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257672 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257879 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.257981 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258181 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258269 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258484 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258572 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.258889 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259094 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259239 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259429 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259521 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259729 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.259826 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260027 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260124 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260325 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260420 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260618 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260709 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.260926 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261014 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261229 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261488 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261586 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261807 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.261895 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262114 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262203 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262414 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262512 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262709 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.262798 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263010 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263099 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263333 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263444 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263644 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263741 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.263949 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264037 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264245 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264344 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264542 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264631 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264845 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.264933 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265146 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265248 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265441 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265542 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265751 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.265846 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266098 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266285 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266397 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266693 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266887 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.266996 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267233 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267337 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267553 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267642 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267875 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.267971 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268185 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268289 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268494 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268581 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268792 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.268886 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269096 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269198 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269395 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269499 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269692 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269780 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.269989 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270086 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270290 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270378 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270587 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270675 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270882 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.270979 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271181 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271322 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271500 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271589 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271798 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.271888 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272114 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272203 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272421 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272509 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272719 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.272864 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273017 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273106 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273315 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273418 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273654 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273742 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.273954 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274044 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274253 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274350 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274554 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274643 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274875 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.274963 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275186 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275311 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275511 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275600 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275816 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.275902 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276133 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276246 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276416 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276494 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276826 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.276927 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277022 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277105 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277309 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277400 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277606 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277694 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277902 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.277992 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278206 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278296 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278508 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278596 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278808 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.278898 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279115 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279265 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279455 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279534 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279753 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.279850 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280055 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280143 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280354 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280451 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280656 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280743 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.280952 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281038 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281252 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281354 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281601 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281716 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.281917 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.282225 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.282431 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.282530 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.282754 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.282851 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283063 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283151 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283411 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283519 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283727 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.283814 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284027 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284114 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284323 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284411 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284629 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284725 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.284930 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285066 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285227 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285524 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285622 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285821 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.285908 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286126 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286223 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286427 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286516 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286732 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.286855 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287040 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287223 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287369 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287483 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287671 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287783 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.287974 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288091 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288279 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288395 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288580 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288706 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.288883 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289012 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289185 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289308 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289486 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289717 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.289818 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290023 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290112 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290330 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290418 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290634 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290738 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.290934 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291023 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291253 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291346 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291622 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291723 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291877 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.291966 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292174 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292261 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292474 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292564 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.292859 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293087 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293175 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293386 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293476 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293705 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.293797 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294101 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294314 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294404 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294627 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294717 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.294947 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295076 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295279 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295409 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295584 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295715 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.295884 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296032 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296201 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296349 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296513 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296666 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296823 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.296965 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.297169 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.297299 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.297605 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.297927 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298027 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298241 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298332 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298547 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298636 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298854 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.298951 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299152 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299275 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299584 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299808 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.299899 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300111 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300210 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300421 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300509 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300733 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.300830 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301046 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301141 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301356 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301452 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301666 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301763 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.301971 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302060 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302283 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302372 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302587 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302674 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302885 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.302973 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303181 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303286 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303502 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303593 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303812 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.303905 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304109 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304197 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304409 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304497 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304709 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.304796 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305015 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305101 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305397 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305485 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305698 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.305787 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306015 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306154 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306315 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306415 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306620 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306716 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.306925 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307012 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307449 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307555 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307555 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307726 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307863 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.307953 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308180 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308278 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308482 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308571 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308781 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.308870 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309080 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309178 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309381 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309472 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309714 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.309809 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310015 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310113 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310328 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310417 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310650 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310738 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.310962 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311058 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311286 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311389 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311613 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311700 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.311921 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312011 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312235 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312326 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312548 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312637 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.312945 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.313241 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.313500 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.313589 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.313820 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.313918 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314121 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314239 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314422 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314553 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314721 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.314866 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315024 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315277 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315421 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315541 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315719 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.315864 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316016 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316169 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316330 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316482 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316629 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.316792 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.317303 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.317474 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.317606 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.317796 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.317892 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318110 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318201 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318424 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318512 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318728 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.318817 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319053 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319143 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319416 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319506 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319722 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.319829 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320039 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320124 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320350 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320436 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320664 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320760 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.320977 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321064 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321291 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321380 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321604 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321700 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.321916 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322006 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322230 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322317 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322535 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322631 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322835 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.322931 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323137 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323260 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323476 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323568 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323776 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.323999 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324088 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324325 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324424 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324637 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324727 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.324945 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325034 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325253 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325351 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325563 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325659 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325863 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.325951 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326164 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326260 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326471 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326559 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326776 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.326873 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327082 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327236 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327421 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327510 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327739 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.327827 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.328044 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.328132 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.328350 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.328497 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.328737 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329167 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329267 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329491 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329580 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329804 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.329893 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330146 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330284 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330452 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330541 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330754 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.330843 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331065 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331155 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331399 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331489 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331709 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.331809 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332019 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332108 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332326 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332414 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332632 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332735 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.332942 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333040 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333248 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333337 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333550 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333647 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333862 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.333959 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334168 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334264 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334473 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334564 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334776 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.334873 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335091 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335180 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335428 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335559 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335728 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.335816 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336031 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336121 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336353 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336533 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336656 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336846 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.336972 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337174 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337315 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337585 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337815 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.337903 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338129 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338220 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338443 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338540 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338751 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.338837 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339050 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339148 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339381 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339472 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339689 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339778 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.339994 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340085 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340293 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340382 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340611 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340699 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.340915 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341006 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341216 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341316 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341531 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341694 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341836 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.341923 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.342146 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.342355 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.342446 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.342704 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.342794 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343013 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343102 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343369 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343597 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343701 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.343928 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.344053 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.344455 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.344715 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.344814 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345038 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345127 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345353 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345440 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345665 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345762 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.345971 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346059 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346272 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346361 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346574 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346673 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346881 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.346969 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347182 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347316 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347505 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347608 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347810 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.347899 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348111 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348198 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348434 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348524 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348734 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.348830 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349036 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349125 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349336 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349426 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349644 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349733 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.349945 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350033 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350244 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350333 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350542 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350637 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350838 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.350935 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351143 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351249 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351466 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351555 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351771 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.351871 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352070 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352167 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352375 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352475 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352673 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352770 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.352975 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353063 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353270 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353373 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353578 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353678 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353881 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.353971 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354200 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354286 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354521 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354616 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354826 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.354915 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355136 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355254 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355465 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355554 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355772 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.355860 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.356112 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.356287 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.356424 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.356606 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.356942 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357036 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357267 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357374 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357581 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357674 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357895 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.357992 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358213 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358310 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358510 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358599 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358815 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.358911 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359115 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359269 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359449 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359538 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359778 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.359876 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360087 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360397 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360563 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360697 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360897 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.360993 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361214 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361304 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361522 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361623 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361846 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.361944 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.362159 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.362250 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.362460 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.362688 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.362776 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363040 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363137 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363378 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363479 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363691 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.363790 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364002 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364100 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364317 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364406 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364623 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364711 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.364935 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365023 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365243 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365331 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365637 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365849 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.365945 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366153 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366242 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366455 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366542 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366753 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.366850 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367059 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367146 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367397 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367501 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367701 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367807 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.367999 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368090 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368300 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368400 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368630 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368719 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.368936 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369032 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369240 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369344 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369546 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369636 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369863 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.369972 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370161 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370251 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370465 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370553 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370768 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.370857 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371068 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371166 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371402 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371492 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371707 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.371796 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372015 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372105 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372317 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372406 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372625 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372726 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.372926 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373016 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373234 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373332 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373522 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373619 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373838 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.373927 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374138 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374226 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374432 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374528 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374730 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.374829 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.375032 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.375122 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.375445 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.375603 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.375807 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376106 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376256 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376402 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376585 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376707 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.376946 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377276 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377365 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377568 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377807 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.377898 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378146 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378235 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378441 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378537 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378744 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.378835 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379043 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379134 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379370 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379471 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379668 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379756 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.379967 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380056 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380264 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380367 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380588 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380677 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380906 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.380994 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381212 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381302 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381519 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381607 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381820 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.381909 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382127 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382217 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382427 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382515 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382735 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.382822 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383046 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383137 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383376 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383466 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383684 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383782 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.383992 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384083 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384300 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384396 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384605 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384705 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384907 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.384996 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385210 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385302 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385515 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385613 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385819 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.385907 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.386137 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.386417 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.386516 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.386738 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.386828 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387046 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387135 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387380 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387484 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387688 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387828 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.387994 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388082 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388351 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388458 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388624 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388721 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.388929 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389022 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389229 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389317 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389528 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389641 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389834 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.389951 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390139 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390269 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390447 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390589 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390751 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.390918 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.391097 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.391433 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.391745 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.391845 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392065 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392154 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392385 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392476 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392688 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.392777 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393009 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393107 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393327 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393415 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393675 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393772 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.393985 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394082 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394320 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394409 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394625 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394711 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.394937 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395035 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395262 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395366 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395562 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395651 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.395801 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112307) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:34:50.395891 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.396173 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.396476 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.396777 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.397085 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.397388 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.397692 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.397995 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.398297 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.398602 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.398903 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.399213 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.399525 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.399824 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.400126 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.400427 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.400733 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.401037 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.401335 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.401634 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.401934 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.402232 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.402562 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.402893 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.403226 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.403553 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.403863 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.404187 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.404495 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.404814 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.405133 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.405445 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.405755 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.406086 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.406395 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.407232 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.407562 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.407880 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.408197 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.408512 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.408840 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.409169 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.409536 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.409865 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.410184 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.410506 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.410821 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.411133 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.411499 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.411810 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.412120 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.412428 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.412738 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.413049 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.413362 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.413671 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.413982 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.414298 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.414615 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.414939 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.415294 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.415603 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.415927 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.416251 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.416596 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.416913 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.417249 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.417574 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.417889 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.418200 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.418503 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:34:50.418745 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:34:50.552256 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO dbcounter [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Registered counter for database nova_api Aug 24 06:34:50.573423 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.580204 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writer thread running {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.582125 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO dbcounter [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Registered counter for database nova_api Aug 24 06:34:50.603115 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_db.sqlalchemy.engines [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.610084 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writer thread running {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.635372 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.context [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66(cell1) {{(pid=112307) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:34:50.639287 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.639728 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.641414 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.642315 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.642754 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.644760 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.646718 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO dbcounter [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Registered counter for database nova_cell0 Aug 24 06:34:50.652393 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO dbcounter [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Registered counter for database nova_cell1 Aug 24 06:34:50.660143 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.661866 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.667420 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writer thread running {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.668551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.context [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66(cell1) {{(pid=112306) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:34:50.670097 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writer thread running {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.672680 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.673655 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.675272 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.676010 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.676451 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.678450 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_concurrency.lockutils [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.680451 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO dbcounter [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Registered counter for database nova_cell0 Aug 24 06:34:50.685986 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO dbcounter [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Registered counter for database nova_cell1 Aug 24 06:34:50.694454 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_db.sqlalchemy.engines [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.697739 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_db.sqlalchemy.engines [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.701098 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writer thread running {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.816225 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO dbcounter [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Registered counter for database nova_cell0 Aug 24 06:34:50.826030 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_db.sqlalchemy.engines [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112307) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.831036 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writer thread running {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.846980 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writer thread running {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:50.857143 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO dbcounter [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Registered counter for database nova_cell0 Aug 24 06:34:50.866905 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG oslo_db.sqlalchemy.engines [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:34:50.871514 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writer thread running {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:34:51.171823 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: WARNING keystonemiddleware.auth_token [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:34:51.179529 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: WARNING keystonemiddleware.auth_token [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:34:51.195817 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: WARNING keystonemiddleware.auth_token [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:34:51.203306 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: WARNING keystonemiddleware.auth_token [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:34:51.530133 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: WARNING keystonemiddleware.auth_token [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:34:51.536309 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: WARNING keystonemiddleware.auth_token [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:34:51.541606 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562a913e9c0 pid: 112307 (default app) Aug 24 06:34:51.543752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:51.544952 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 24 06:34:51.545371 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Wed Aug 24 06:34:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:34:51.563726 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: WARNING keystonemiddleware.auth_token [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:34:51.570182 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: WARNING keystonemiddleware.auth_token [None req-8d08657e-0a75-47f5-a632-54775f478db0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:34:51.575530 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5562a913e9c0 pid: 112306 (default app) Aug 24 06:36:10.913550 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:10.914576 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 06:36:10.914983 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:10.927589 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_api:SELECT=3 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:10.928558 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_cell0:SELECT=3 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:10.929843 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_cell1:SELECT=3 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:10.931132 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_cell0:SELECT=3 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:11.777629 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-1b0b3291-feed-4d7d-9216-495b6f5ef516 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:11.809883 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-1b0b3291-feed-4d7d-9216-495b6f5ef516 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.887760 Aug 24 06:36:11.810686 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 06:36:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:14.175813 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:14.176830 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-7a2b6bdc-c57c-4311-bbeb-5586e32cadcd None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 24 06:36:14.177487 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:14.661150 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-e9a586a1-b1e6-42fc-bbcd-af636440f3da admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:14.681298 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:36:14.681298 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: warnings.warn(msg) Aug 24 06:36:14.710538 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-e9a586a1-b1e6-42fc-bbcd-af636440f3da admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.526844 Aug 24 06:36:14.711491 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:14.725890 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_api:SELECT=3 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:14.726680 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_cell0:SELECT=3 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:14.728152 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_cell1:SELECT=3 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:14.729070 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:14.932800 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-fb32d834-9944-40cb-b8ff-7e62e140f592 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:14.937168 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:36:14.937168 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:36:15.005616 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-fb32d834-9944-40cb-b8ff-7e62e140f592 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285969 Aug 24 06:36:15.006169 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 06:36:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:17.372605 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-e9a586a1-b1e6-42fc-bbcd-af636440f3da admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:17.373758 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-e9a586a1-b1e6-42fc-bbcd-af636440f3da admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 24 06:36:17.374187 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:18.039501 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-1ea8cd7e-d6a1-4113-bdac-e3f676894ca0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:18.058621 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:36:18.058621 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:36:18.081757 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-1ea8cd7e-d6a1-4113-bdac-e3f676894ca0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700042 Aug 24 06:36:18.082358 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:18.095602 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-268891c1-a930-4165-8e76-ebb69d2d67ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:18.099214 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:36:18.099214 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: warnings.warn(msg) Aug 24 06:36:18.133210 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-268891c1-a930-4165-8e76-ebb69d2d67ad admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041630 Aug 24 06:36:18.133978 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 06:36:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:20.536222 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-1ea8cd7e-d6a1-4113-bdac-e3f676894ca0 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:20.537253 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-1ea8cd7e-d6a1-4113-bdac-e3f676894ca0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 24 06:36:20.537662 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:36:20.956044 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-1eb2ba60-e348-4a9e-b0aa-0ac9fb7c1e06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:20.975691 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-1eb2ba60-e348-4a9e-b0aa-0ac9fb7c1e06 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431938 Aug 24 06:36:20.976249 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:20.988727 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-50ea12c0-b16e-44f9-b8be-f43c11fa178b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:21.013476 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-50ea12c0-b16e-44f9-b8be-f43c11fa178b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028708 Aug 24 06:36:21.014032 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 06:36:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:23.376937 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-1eb2ba60-e348-4a9e-b0aa-0ac9fb7c1e06 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:23.378451 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-1eb2ba60-e348-4a9e-b0aa-0ac9fb7c1e06 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 24 06:36:23.378890 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:23.838583 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-0e1513d2-8ed2-4533-91b8-7ca69675fc52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:23.870777 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-0e1513d2-8ed2-4533-91b8-7ca69675fc52 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485085 Aug 24 06:36:23.871810 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:23.884303 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d3289042-0170-4820-997f-b2a66f37ca29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:23.911238 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d3289042-0170-4820-997f-b2a66f37ca29 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030759 Aug 24 06:36:23.912171 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 06:36:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:26.274324 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-0e1513d2-8ed2-4533-91b8-7ca69675fc52 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:26.275538 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-0e1513d2-8ed2-4533-91b8-7ca69675fc52 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Aug 24 06:36:26.276212 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:26.757427 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "disk": 20, "id": "d4"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:26.778184 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495694 Aug 24 06:36:26.778855 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:36:26.792205 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-8a455f47-bb69-4f25-bf95-b8b65e98bc9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:26.821007 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-8a455f47-bb69-4f25-bf95-b8b65e98bc9d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033053 Aug 24 06:36:26.821605 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Wed Aug 24 06:36:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:29.297767 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:29.299003 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001852 Aug 24 06:36:29.299660 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:29.773530 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-1f9e1eb3-7421-4057-85a8-c3edabb69684 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:29.843510 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-1f9e1eb3-7421-4057-85a8-c3edabb69684 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.536602 Aug 24 06:36:29.844063 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 06:36:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:33.041787 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:33.042914 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d06d826d-42c5-4fa6-a24c-b9e5a5cb0e51 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Aug 24 06:36:33.043314 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:33.469263 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-e1183bd2-b0fc-41cb-a965-c490558a0ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:33.489554 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-e1183bd2-b0fc-41cb-a965-c490558a0ff8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.439554 Aug 24 06:36:33.490331 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:33.502302 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-2256a800-696d-4dac-9428-6af144d24825 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:33.528160 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-2256a800-696d-4dac-9428-6af144d24825 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029492 Aug 24 06:36:33.528919 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 06:36:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:35.865834 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-e1183bd2-b0fc-41cb-a965-c490558a0ff8 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:35.866975 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-e1183bd2-b0fc-41cb-a965-c490558a0ff8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001936 Aug 24 06:36:35.867606 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:36.262586 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4f6e401a-3949-4a30-b4b2-29c2c68f1018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "vcpus": 1, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:36.284100 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-4f6e401a-3949-4a30-b4b2-29c2c68f1018 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407168 Aug 24 06:36:36.284855 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:36:36.297290 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-3c196ace-1591-4095-904c-a3f01332cdc8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:36.325089 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-3c196ace-1591-4095-904c-a3f01332cdc8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031594 Aug 24 06:36:36.325861 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 06:36:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:38.719136 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4f6e401a-3949-4a30-b4b2-29c2c68f1018 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:38.720907 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-4f6e401a-3949-4a30-b4b2-29c2c68f1018 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Aug 24 06:36:38.721297 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:39.213508 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-007493ee-2a8d-4f90-8c8b-394d69f345d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:39.240375 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-007493ee-2a8d-4f90-8c8b-394d69f345d4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.512507 Aug 24 06:36:39.241565 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:38 2022] POST /compute/v2.1/flavors => generated 406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:39.253604 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4d1033f5-8a30-491c-b0c1-36bfceed2f83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:39.278601 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-4d1033f5-8a30-491c-b0c1-36bfceed2f83 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028948 Aug 24 06:36:39.279706 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 06:36:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:41.683520 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-007493ee-2a8d-4f90-8c8b-394d69f345d4 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:41.684445 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-007493ee-2a8d-4f90-8c8b-394d69f345d4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 24 06:36:41.685103 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:42.126319 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-beb8bb42-aa4b-4492-817a-03d1144a949f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "id": "4", "swap": 0, "ram": 8192, "name": "m1.large", "vcpus": 4}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:42.132828 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:42.149362 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-beb8bb42-aa4b-4492-817a-03d1144a949f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458264 Aug 24 06:36:42.149914 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:36:42.162160 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-d87baec1-03ea-4fd8-b788-f1d0b8d570bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:42.192378 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-d87baec1-03ea-4fd8-b788-f1d0b8d570bf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033483 Aug 24 06:36:42.193335 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 06:36:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:44.596902 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-beb8bb42-aa4b-4492-817a-03d1144a949f admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:44.598179 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-beb8bb42-aa4b-4492-817a-03d1144a949f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Aug 24 06:36:44.598635 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:36:45.050014 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "ram": 16384, "id": "5", "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge"}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:45.058392 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:45.073821 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.469102 Aug 24 06:36:45.074629 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Wed Aug 24 06:36:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:36:45.086930 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-69ece77b-7ab2-439a-a7db-669858569a2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:36:45.115269 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-69ece77b-7ab2-439a-a7db-669858569a2e admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031926 Aug 24 06:36:45.115855 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Wed Aug 24 06:36:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:03.336366 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:03.338085 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002478 Aug 24 06:37:03.338737 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:03.356622 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.803901 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-8d586b17-7f78-47ec-b452-b42d0b8fc60a admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:03.826471 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-8d586b17-7f78-47ec-b452-b42d0b8fc60a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.477546 Aug 24 06:37:03.826983 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 06:37:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:04.929946 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:04.931438 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-9f20d9e1-ed0d-417a-921d-52c0468956c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002181 Aug 24 06:37:04.931924 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:05.497470 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-ca672343-89ca-48ce-a6e2-fce0ffc2ad4f admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.503185 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.wsgi [None req-ca672343-89ca-48ce-a6e2-fce0ffc2ad4f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-ca672343-89ca-48ce-a6e2-fce0ffc2ad4f admin admin] Request method failure captured: Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept: application/json Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept-Encoding: gzip, deflate Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Connection: keep-alive Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Content-Length: 0 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Host: 10.222.0.52 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-System-Scope: None Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: User-Agent: python-novaclient Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Auth-Token: gAAAAABjBccQHdgwqou9uufxaZdgcaJ5Dk7UIHafBHRhtiOf2DuTI4akBA7DXKzL9HJvwCED3nbDJPjcLWq8B3laZAaPlgti7F3Vn85hLfANWoWlay0fP-SMuELS20bM6JZZf0g_wVC5_AnT1YfngAkz50KZ6ImimL34Zh0JiiRISXA9hXLwMJ0 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Id: None Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Name: None Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Identity-Status: Confirmed Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Is-Admin-Project: True Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Id: default Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Name: Default Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Name: admin Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Role: admin,member,reader Aug 24 06:37:05.506689 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Roles: admin,member,reader Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant: admin Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Name: admin Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User: admin Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Id: default Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Name: Default Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Name: admin Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: method: > Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: exception: Flavor 42 could not be found. Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: action_args: {'id': '42'} Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:05.508237 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:05.509164 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.510478 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-ca672343-89ca-48ce-a6e2-fce0ffc2ad4f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:05.511612 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-ca672343-89ca-48ce-a6e2-fce0ffc2ad4f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.438092 Aug 24 06:37:05.511612 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:05.518123 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-1d26e004-fc2e-45e3-be5a-11fa4f0c395c admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.541988 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-1d26e004-fc2e-45e3-be5a-11fa4f0c395c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027532 Aug 24 06:37:05.542552 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:05.552775 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-c7a8008f-db0a-4c6e-963c-1bcea3e60c58 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.577013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-c7a8008f-db0a-4c6e-963c-1bcea3e60c58 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027912 Aug 24 06:37:05.577549 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:05.587342 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-f94cbf9e-c84c-4dc8-b85a-45599fdaca70 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.593428 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.wsgi [None req-f94cbf9e-c84c-4dc8-b85a-45599fdaca70 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-f94cbf9e-c84c-4dc8-b85a-45599fdaca70 admin admin] Request method failure captured: Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept: application/json Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept-Encoding: gzip, deflate Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Connection: keep-alive Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Content-Length: 0 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Host: 10.222.0.52 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-System-Scope: None Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: User-Agent: python-novaclient Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Auth-Token: gAAAAABjBccQHdgwqou9uufxaZdgcaJ5Dk7UIHafBHRhtiOf2DuTI4akBA7DXKzL9HJvwCED3nbDJPjcLWq8B3laZAaPlgti7F3Vn85hLfANWoWlay0fP-SMuELS20bM6JZZf0g_wVC5_AnT1YfngAkz50KZ6ImimL34Zh0JiiRISXA9hXLwMJ0 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Id: None Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Name: None Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Identity-Status: Confirmed Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Is-Admin-Project: True Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Id: default Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Name: Default Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Name: admin Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Role: admin,member,reader Aug 24 06:37:05.596752 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Roles: admin,member,reader Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant: admin Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Name: admin Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User: admin Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Id: default Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Name: Default Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Name: admin Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: method: > Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: exception: Flavor 42 could not be found. Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: action_args: {'id': '42'} Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:05.598495 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:05.599555 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:05.600818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-f94cbf9e-c84c-4dc8-b85a-45599fdaca70 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:05.602052 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-f94cbf9e-c84c-4dc8-b85a-45599fdaca70 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014527 Aug 24 06:37:05.602052 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:06.612387 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-c7a8008f-db0a-4c6e-963c-1bcea3e60c58 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:06.613407 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-c7a8008f-db0a-4c6e-963c-1bcea3e60c58 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 06:37:06.613801 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:07.185143 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-399e0a91-3435-47fd-b20e-495c8ee86b04 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.193782 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.wsgi [None req-399e0a91-3435-47fd-b20e-495c8ee86b04 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-399e0a91-3435-47fd-b20e-495c8ee86b04 admin admin] Request method failure captured: Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept: application/json Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept-Encoding: gzip, deflate Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Connection: keep-alive Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Content-Length: 0 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Host: 10.222.0.52 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-System-Scope: None Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: User-Agent: python-novaclient Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Auth-Token: gAAAAABjBccSGKjHEGeZUzU4PEDphf8v-JWbhq9ZAmrY5bCayNjg0gdu87EPgZAeUxReyXswSUiQgSsod5auS1nkluwrpga4QPGdhr2uVWwDIGOj7mSVrkqPSyzXowKDBqIjQirHGLba5V-N-jzvQ1NgFDust0oYAjCyMpMmel7hrFyfHBaJlL0 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Id: None Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Name: None Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Identity-Status: Confirmed Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Is-Admin-Project: True Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Id: default Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Name: Default Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Name: admin Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Role: admin,member,reader Aug 24 06:37:07.195411 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Roles: admin,member,reader Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant: admin Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Name: admin Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User: admin Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Id: default Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Name: Default Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Name: admin Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: method: > Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: exception: Flavor 84 could not be found. Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: action_args: {'id': '84'} Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:07.196904 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:07.197770 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.199056 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-399e0a91-3435-47fd-b20e-495c8ee86b04 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:07.200393 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-399e0a91-3435-47fd-b20e-495c8ee86b04 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.442928 Aug 24 06:37:07.200393 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 06:37:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:07.206688 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-9c51e843-5bc0-4552-8490-548a4463cdd6 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.222588 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-9c51e843-5bc0-4552-8490-548a4463cdd6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019488 Aug 24 06:37:07.223420 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:07.233187 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-0b9e11d4-94ee-45a1-b6eb-01532409b854 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.248650 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-0b9e11d4-94ee-45a1-b6eb-01532409b854 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019137 Aug 24 06:37:07.249173 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:07.261639 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-c93d7470-7fd0-4430-8fe9-57146ef14d4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.270925 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.wsgi [None req-c93d7470-7fd0-4430-8fe9-57146ef14d4d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-c93d7470-7fd0-4430-8fe9-57146ef14d4d admin admin] Request method failure captured: Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept: application/json Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept-Encoding: gzip, deflate Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Connection: keep-alive Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Content-Length: 0 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Host: 10.222.0.52 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-System-Scope: None Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: User-Agent: python-novaclient Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Auth-Token: gAAAAABjBccSGKjHEGeZUzU4PEDphf8v-JWbhq9ZAmrY5bCayNjg0gdu87EPgZAeUxReyXswSUiQgSsod5auS1nkluwrpga4QPGdhr2uVWwDIGOj7mSVrkqPSyzXowKDBqIjQirHGLba5V-N-jzvQ1NgFDust0oYAjCyMpMmel7hrFyfHBaJlL0 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Id: None Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Name: None Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Identity-Status: Confirmed Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Is-Admin-Project: True Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Id: default Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Name: Default Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Name: admin Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Role: admin,member,reader Aug 24 06:37:07.273368 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Roles: admin,member,reader Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant: admin Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Name: admin Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User: admin Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Id: default Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Name: Default Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Name: admin Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: method: > Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: exception: Flavor 84 could not be found. Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: action_args: {'id': '84'} Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:07.275551 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:07.276529 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:07.277793 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-c93d7470-7fd0-4430-8fe9-57146ef14d4d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:07.279032 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-c93d7470-7fd0-4430-8fe9-57146ef14d4d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.019658 Aug 24 06:37:07.279032 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Wed Aug 24 06:37:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:08.291271 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-0b9e11d4-94ee-45a1-b6eb-01532409b854 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.292880 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-0b9e11d4-94ee-45a1-b6eb-01532409b854 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 Aug 24 06:37:08.293494 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:08.886050 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4bdd5da5-a86f-4dcb-b453-7913f1d357d8 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.892331 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.wsgi [None req-4bdd5da5-a86f-4dcb-b453-7913f1d357d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4bdd5da5-a86f-4dcb-b453-7913f1d357d8 admin admin] Request method failure captured: Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept: application/json Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Accept-Encoding: gzip, deflate Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Connection: keep-alive Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Content-Length: 0 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Host: 10.222.0.52 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Openstack-System-Scope: None Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: User-Agent: python-novaclient Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Auth-Token: gAAAAABjBccUkMJ0RNbowOE42aDsESZQI0TNB6RW0btSaY4_a5jUBRY72Bnvsr6XN9SEBC1M4_PQ36gvBehqlmdKAiCmuX4nJfFGEXWhZUDFjxDDYtMqAK-G9EMhIhhbug5q5iidfYwq-5Si_pEoOh_NrBoQ2-Gl_bn5xoH2un3QKzdmLf6mkmQ Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Id: None Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Domain-Name: None Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Identity-Status: Confirmed Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Is-Admin-Project: True Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Id: default Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Domain-Name: Default Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Project-Name: admin Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Role: admin,member,reader Aug 24 06:37:08.893839 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Roles: admin,member,reader Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant: admin Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-Tenant-Name: admin Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User: admin Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Id: default Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Domain-Name: Default Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: X-User-Name: admin Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: method: > Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: exception: Flavor 451 could not be found. Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: action_args: {'id': '451'} Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:08.895548 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:08.896851 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.899013 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-4bdd5da5-a86f-4dcb-b453-7913f1d357d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:08.901053 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-4bdd5da5-a86f-4dcb-b453-7913f1d357d8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.456698 Aug 24 06:37:08.901053 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:08.907523 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-e3eeb030-9456-47ab-a978-9d76d98a12c3 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.922551 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-e3eeb030-9456-47ab-a978-9d76d98a12c3 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018691 Aug 24 06:37:08.923085 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:08.932884 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.948862 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019494 Aug 24 06:37:08.949379 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:08.959123 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-00c31b4d-3118-4ad5-94e2-b021cda772c7 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.964881 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.wsgi [None req-00c31b4d-3118-4ad5-94e2-b021cda772c7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-00c31b4d-3118-4ad5-94e2-b021cda772c7 admin admin] Request method failure captured: Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept: application/json Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Accept-Encoding: gzip, deflate Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Connection: keep-alive Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Content-Length: 0 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Host: 10.222.0.52 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-Api-Version: compute 2.90 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Openstack-System-Scope: None Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: User-Agent: python-novaclient Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Auth-Token: gAAAAABjBccUkMJ0RNbowOE42aDsESZQI0TNB6RW0btSaY4_a5jUBRY72Bnvsr6XN9SEBC1M4_PQ36gvBehqlmdKAiCmuX4nJfFGEXWhZUDFjxDDYtMqAK-G9EMhIhhbug5q5iidfYwq-5Si_pEoOh_NrBoQ2-Gl_bn5xoH2un3QKzdmLf6mkmQ Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Id: None Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Domain-Name: None Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Identity-Status: Confirmed Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Is-Admin-Project: True Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Id: default Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Domain-Name: Default Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Project-Name: admin Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Role: admin,member,reader Aug 24 06:37:08.966388 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Roles: admin,member,reader Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4d0ff1eb049e4a50aede95b2f05e94b7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4d0ff1eb049e4a50aede95b2f05e94b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant: admin Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Id: 4d0ff1eb049e4a50aede95b2f05e94b7 Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-Tenant-Name: admin Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User: admin Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Id: default Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Domain-Name: Default Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Id: 66932a6f9a244fcaa7375a468f28c399 Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: X-User-Name: admin Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: method: > Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: exception: Flavor 451 could not be found. Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: action_args: {'id': '451'} Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:37:08.968031 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:08.968938 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: ERROR nova.api.openstack.wsgi Aug 24 06:37:08.970037 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-00c31b4d-3118-4ad5-94e2-b021cda772c7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112307) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:37:08.971148 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-00c31b4d-3118-4ad5-94e2-b021cda772c7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012539 Aug 24 06:37:08.971148 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:37:09.975582 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:09.976578 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 24 06:37:09.976995 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:10.537989 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-4db413a6-9f67-45c3-8cd4-a1c65db27b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:37:10.564023 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-4db413a6-9f67-45c3-8cd4-a1c65db27b7c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.443065 Aug 24 06:37:10.564693 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 06:37:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:37:11.587298 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:11.588319 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 24 06:37:11.588718 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:12.156474 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-d52b4e3a-40ee-42ab-a831-ed788bea9d05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:37:12.181138 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-d52b4e3a-40ee-42ab-a831-ed788bea9d05 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.454308 Aug 24 06:37:12.181684 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 06:37:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:37:13.207639 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:13.208943 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001780 Aug 24 06:37:13.209359 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:13.782900 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-8e28a705-f89c-4d55-bf82-a56b942a1323 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:37:13.810564 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-8e28a705-f89c-4d55-bf82-a56b942a1323 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.465711 Aug 24 06:37:13.811146 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 06:37:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:37:14.821001 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:14.821987 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 24 06:37:14.822377 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:15.418907 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-9cec2c7c-ac0d-4ef2-8fa5-5debecc25d56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:37:15.440106 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-9cec2c7c-ac0d-4ef2-8fa5-5debecc25d56 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.478485 Aug 24 06:37:15.440668 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Wed Aug 24 06:37:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:37:16.437804 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:16.438818 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 24 06:37:16.439228 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:37:16.993145 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-782cc862-3838-4bec-946a-9c0fbbe04270 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:17.013888 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-782cc862-3838-4bec-946a-9c0fbbe04270 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.436259 Aug 24 06:37:17.014421 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Wed Aug 24 06:37:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:11.821296 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:11.822780 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-d4aee3c7-24bd-4f68-bc8c-b1e5062a0f4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 Aug 24 06:38:11.823467 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Wed Aug 24 06:38:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:11.840835 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.268958 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-a998730d-52b3-46a2-a1e2-3082ee81acfc admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.289699 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-a998730d-52b3-46a2-a1e2-3082ee81acfc admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.456327 Aug 24 06:38:12.290229 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Wed Aug 24 06:38:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:12.318160 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG dbcounter [-] [112306] Writing DB stats nova_api:SELECT=14 {{(pid=112306) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.324341 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-42584b08-0aec-4a7d-a99a-6240a9971b62 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.335120 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-42584b08-0aec-4a7d-a99a-6240a9971b62 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020703 Aug 24 06:38:12.335659 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:12.348271 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-2d6af445-0290-45c3-9a5c-775b5890df26 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.356187 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-2d6af445-0290-45c3-9a5c-775b5890df26 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011993 Aug 24 06:38:12.356706 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:12.368633 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.376248 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011250 Aug 24 06:38:12.376762 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:12.391039 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-35378197-e80d-483e-a198-65bf448b4639 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.399415 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-35378197-e80d-483e-a198-65bf448b4639 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014006 Aug 24 06:38:12.400072 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:41:15.125532 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:15.126537 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 24 06:41:15.126926 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:15.268200 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_api:SELECT=6 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:15.446437 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:15.448818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:41:15.448818 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:41:15.449964 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.450464 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.450883 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.451607 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:15.452091 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:15.452512 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:15.490576 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-c2eaf020-28f9-4071-b94a-ad2677d96ff2 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.224792 Aug 24 06:41:15.491144 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:41:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:16.317287 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.318284 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 06:41:16.318771 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:16.518084 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:16.521763 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:41:16.521763 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:41:16.523350 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.523974 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.524600 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.525463 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:16.526467 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:16.527387 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:16.548465 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-0898240f-74ec-45b4-8a2c-ba12bad59045 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090380 Aug 24 06:41:16.549731 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:41:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:27.804144 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:27.805189 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 24 06:41:27.805582 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:27.958328 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_cell0:SELECT=4 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:27.959051 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_cell1:SELECT=4 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:27.959753 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG dbcounter [-] [112307] Writing DB stats nova_api:SELECT=8 {{(pid=112307) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:28.011114 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.013488 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:41:28.013488 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:41:28.014584 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.015057 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.015515 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.016228 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:28.016665 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:28.017080 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:28.043058 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-06166eb3-d009-4d6c-b372-5339ed14a36c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090898 Aug 24 06:41:28.043642 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:41:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:41:28.892534 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: DEBUG nova.api.openstack.wsgi [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] Calling method '>' {{(pid=112306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:28.893804 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: INFO nova.api.openstack.requestlog [None req-0b9186fd-dc4e-4cf0-8480-2f6847fcc027 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Aug 24 06:41:28.894348 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: [pid: 112306|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Wed Aug 24 06:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:41:29.110882 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG nova.api.openstack.wsgi [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Calling method '>' {{(pid=112307) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:29.113317 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:41:29.113317 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: warnings.warn(msg) Aug 24 06:41:29.114421 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.114898 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.115361 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.116082 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:29.116528 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:29.116942 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: DEBUG oslo_concurrency.lockutils [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112307) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:29.138997 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: INFO nova.api.openstack.requestlog [None req-068e03c1-c0bd-4925-99ca-feabeeb75a1c admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.101015 Aug 24 06:41:29.139599 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: [pid: 112307|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Wed Aug 24 06:41:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:42:25.415938 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: Wed Aug 24 06:42:25 2022 - graceful shutdown triggered... Aug 24 06:42:25.416468 dv-cinder-854271-1-iscsi devstack@n-api.service[112307]: Gracefully killing worker 2 (pid: 112307)... Aug 24 06:42:25.416830 dv-cinder-854271-1-iscsi devstack@n-api.service[112306]: Gracefully killing worker 1 (pid: 112306)... Aug 24 06:42:25.418037 dv-cinder-854271-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 06:42:26.417106 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: worker 1 buried after 1 seconds Aug 24 06:42:26.417106 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: worker 2 buried after 1 seconds Aug 24 06:42:26.417106 dv-cinder-854271-1-iscsi devstack@n-api.service[112305]: goodbye to uWSGI. Aug 24 06:42:26.419631 dv-cinder-854271-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 06:42:26.420288 dv-cinder-854271-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 06:42:26.423588 dv-cinder-854271-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:42:26.437024 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:42:26 2022] *** Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: nodename: dv-cinder-854271-1-iscsi Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: machine: x86_64 Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: clock source: unix Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: pcre jit disabled Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: detected number of CPU cores: 4 Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: current working directory: / Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:42:26.439462 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: your processes number limit is 47680 Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: your memory page size is 4096 bytes Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: detected max file descriptor number: 2048 Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: lock engine: pthread robust mutexes Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: thunder lock: enabled Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:42:26.440329 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:42:26.479458 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: Python main interpreter initialized at 0x55faf642d9c0 Aug 24 06:42:26.479458 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: python threads support enabled Aug 24 06:42:26.479458 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: your server socket listen backlog is limited to 100 connections Aug 24 06:42:26.479458 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:42:26.479946 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:42:26.479946 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: *** Operational MODE: preforking *** Aug 24 06:42:26.480508 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:42:26.480508 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: spawned uWSGI master process (pid: 127276) Aug 24 06:42:26.480730 dv-cinder-854271-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:42:26.481812 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: spawned uWSGI worker 1 (pid: 127290, cores: 1) Aug 24 06:42:26.481812 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: spawned uWSGI worker 2 (pid: 127291, cores: 1) Aug 24 06:42:26.481812 dv-cinder-854271-1-iscsi devstack@n-api.service[127276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:42:27.144144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:42:27.146963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:42:28.297031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:42:28.297031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: from cryptography.utils import int_from_bytes Aug 24 06:42:28.300053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:42:28.300053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: from cryptography.utils import int_from_bytes Aug 24 06:42:28.300187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:42:28.300187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: from cryptography.utils import int_from_bytes Aug 24 06:42:28.300617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:42:28.300617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: from cryptography.utils import int_from_bytes Aug 24 06:42:30.717981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:42:30.718668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:42:30.718779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:42:30.719114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:42:30.719434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:42:30.719741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:42:30.720176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.720274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:42:30.720358 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.720455 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.720542 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:42:30.720742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.720914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:42:30.721146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:42:30.721269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.721551 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.721687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.721872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722013 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722520 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.722787 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-1-iscsi {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.723785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.724040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.724159 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.724363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.724459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.724645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725285 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725397 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854271-1-iscsi {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.725763 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726000 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726828 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.726947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.727143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.727283 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.727504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.727604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.727830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728361 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728648 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.728962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.729137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.729309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.729459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.729807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.729934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730227 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-1-iscsi {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.730908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731155 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731582 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854271-1-iscsi {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.731911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732244 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732444 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.732862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733777 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.733878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734732 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.734834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.735800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736573 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.736981 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737207 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737534 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737845 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.737943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738198 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738360 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.738775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739711 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.739965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740514 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740825 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.740916 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.741867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742690 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.742995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.743985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744393 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.744947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.745933 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.746892 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747000 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747555 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747652 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.747925 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.748129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.748256 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.748441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.748523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.752983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753636 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753715 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.753962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754686 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.754966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755534 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.755969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.756935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.757874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.758927 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759377 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.759926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760652 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.760759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761470 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.761983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.762994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.763127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.763349 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.763492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.763646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.763854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.764060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.764160 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.764245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.764489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:42:30.764641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.764833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.764990 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.765906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766448 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766550 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.766881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767437 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767542 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.767853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768438 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768757 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.768860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769191 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.769847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.770802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771164 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771526 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771688 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.771784 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772754 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.772979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.773934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774247 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.774971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775224 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775339 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775644 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.775956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.776184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.776293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.776566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.776673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.777945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778147 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778393 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778497 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.778856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.779047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.779182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.779900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780022 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.780897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.781875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782059 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.782905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.783156 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.783532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.783868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.784946 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785248 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785389 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.785830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.786008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.786165 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.795236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.795499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.795672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.795842 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.795944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796703 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.796960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797239 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.797963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798233 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798708 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.798974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799145 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.799865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800301 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.800993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801817 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.801917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802435 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802521 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802605 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802791 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.802971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803063 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803525 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803698 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.803960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.804053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.804146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.807418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.807523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.807611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.807765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.807902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808007 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808147 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.808938 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809501 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809896 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.809968 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810191 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810339 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810412 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810823 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.810974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.811986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812851 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.812938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813106 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813177 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813669 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813842 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813924 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.813999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814159 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814557 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.814640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.817960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818582 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.818966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.819046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.819119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.820754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.820867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.820954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821501 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.821613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.823690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824260 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824571 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.824968 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825589 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825733 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.825969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826198 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826591 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826843 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.826997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.828942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829433 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.829912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.830074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.830226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.830866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831049 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831233 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.831886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.832039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.832191 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.832357 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.832517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.832683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.833882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.834876 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835542 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.835692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836332 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836652 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.836971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837166 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837333 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837635 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.837952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.838936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.839184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.839519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.839679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.839965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.840126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.840287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.840456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.841100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.841292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.841446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.841683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.841840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842654 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.842855 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.843031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.843184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.843615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.843799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844467 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.844938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.845918 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846728 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.846879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847568 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847719 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.847870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848730 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.848888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849358 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849669 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.849992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.850155 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.850315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.850475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.850636 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.851308 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.851481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.851634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.851795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.851956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852437 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.852914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853218 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853379 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853693 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.853999 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.854344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.854729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.854910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.855903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856058 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856217 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.856923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857084 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.857942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.858916 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.859899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860364 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860676 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.860834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.861465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.861465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.862313 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.862489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.862642 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.862801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.862953 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.863935 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.864096 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.864267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.864600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.864778 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.864939 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865572 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.865883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.866879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.867880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868359 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.868838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869007 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869611 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.869930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.870089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.870309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.871538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.871728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.871884 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872224 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872700 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.872868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873482 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.873968 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.874134 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.874292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.874445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.874800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.874972 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875145 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875635 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.875958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.876118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.876442 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.876601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.876790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.881049 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.881284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.881494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.881686 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.881861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.882843 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.883009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.883162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.883415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.884180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.884345 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.884507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.884676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.884866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.885027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.885188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.885349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.885526 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.885680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.886102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887619 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.887942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.888867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889017 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889546 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.889866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.890233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.890403 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.890567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.890720 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.890871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.893385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.893587 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.893800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894256 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894416 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.894908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.895076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.895285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.895443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.895594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.897714 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.897899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898233 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898396 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898701 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.898867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.899031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.899221 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.899430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.899620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.899822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.900860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.901065 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.901218 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.901370 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.901675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.902458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.902614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.902800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.902956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.903891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904647 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.904808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.906219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.906219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.906219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.906219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.907140 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.907696 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.907875 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908515 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.908979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.909292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.909453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.909663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.909825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910191 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910349 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.910949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911922 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.911922 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.912231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.912391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.912561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.912726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.912891 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913534 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.913861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.914048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.914319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.914479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.914641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915173 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915396 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.915849 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.916015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.916168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.916413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.916997 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.917206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.917576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.918460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.918622 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.918776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.918776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.919866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920844 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.920996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921492 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921654 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921974 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.921974 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.922336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.922522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.922678 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.922837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.922989 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.923184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.923962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924388 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.924899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.925261 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.925454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.925612 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.925764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.925925 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.926087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.926249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.926419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.926769 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.927280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.927567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.927724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.927897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.928049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.929420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.929420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.929420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.929966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930138 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930138 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.930940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.931954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.932105 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.932281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.932448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.932604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.932813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.933237 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.933748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.934187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.934344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.934605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.935370 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.935533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.935688 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.935868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936657 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.936953 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.937787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.937949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.937949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.938247 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.938409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.938563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.938856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.939154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.939334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.939524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.939689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.939869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.940829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941643 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.941980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942294 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.942935 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943095 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.943937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.944969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945142 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945455 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.945956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.946114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.946279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.946439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.946590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.946740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.947053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.947376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.947376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.947946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.948106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.948302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.948470 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.949437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.949613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.949768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.949936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.950926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.951896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952218 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952710 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.952871 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.953033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.953186 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.953337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.955836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956530 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.956686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.957013 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.957352 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.957595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.957755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.958991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.959143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.959331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.959672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.959850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960165 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960318 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.960947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961571 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.961732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.962952 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.963794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.964698 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.964881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.965123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.965280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.965521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.965687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.965848 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966834 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.966987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.967155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.967497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.967738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.967896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.968258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.968434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.968589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.968740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.968912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.969078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.969078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.969390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.969543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.969874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.970901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.971883 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.972977 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973791 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.973952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974113 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.974923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.975089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.975331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.975509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.975729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.975898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.976853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.977014 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.977014 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.977327 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.977626 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.977873 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.978039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.978411 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.978569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.978723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.978875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.979027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.979208 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.979368 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.980415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.980590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.980759 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.980912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981075 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981404 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.981868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982035 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982196 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.982862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983520 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.983842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984461 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.984962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.985995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986624 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986789 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.986940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.987100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.987303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.987467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.987783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.988028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.988189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.988564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.988733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.988885 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989047 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989524 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.989856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.990011 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.990991 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.991162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.991351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.991505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.991655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.991814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.992239 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.992416 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.992569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.992720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.992870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.993983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994780 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.994943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.995109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.995365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.995724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.996570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.996738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.996907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.997061 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.997226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.997391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.997544 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.997721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.998077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.998313 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.998763 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.998923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999834 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:30.999998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.000158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.000311 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.000483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.000876 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001047 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.001824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.002931 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.003089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.003330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.003745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.003903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.004065 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.004232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.004408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.004570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.004723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.005514 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.005671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.005842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.006812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.007109 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.007317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.007481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.007634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.007784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.008114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.008300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.008551 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.008949 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009260 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009587 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.009903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010063 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010215 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010697 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.010979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011360 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011435 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011828 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.011902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012196 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012745 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012913 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.012994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.013999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014218 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014525 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.014984 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015160 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.015800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.016862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:42:31.017898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:42:31.043802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO dbcounter [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Registered counter for database nova_api Aug 24 06:42:31.055800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO dbcounter [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Registered counter for database nova_api Aug 24 06:42:31.064965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_db.sqlalchemy.engines [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.071729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writer thread running {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.077174 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_db.sqlalchemy.engines [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.083983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writer thread running {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.128969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.context [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66(cell1) {{(pid=127291) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:42:31.133022 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.133506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.135088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.135951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.136937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.138512 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.140567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO dbcounter [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Registered counter for database nova_cell0 Aug 24 06:42:31.140755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.context [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66(cell1) {{(pid=127290) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:42:31.144650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO dbcounter [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Registered counter for database nova_cell1 Aug 24 06:42:31.144814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.145160 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.146746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.147625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:42:31.148006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:42:31.149942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:42:31.152161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO dbcounter [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Registered counter for database nova_cell0 Aug 24 06:42:31.153192 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_db.sqlalchemy.engines [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.154593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_db.sqlalchemy.engines [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.156380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO dbcounter [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Registered counter for database nova_cell1 Aug 24 06:42:31.161351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writer thread running {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.163113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writer thread running {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.165790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_db.sqlalchemy.engines [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.166572 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_db.sqlalchemy.engines [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.174045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writer thread running {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.175359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writer thread running {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.315781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO dbcounter [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Registered counter for database nova_cell0 Aug 24 06:42:31.322931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_db.sqlalchemy.engines [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.324502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO dbcounter [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Registered counter for database nova_cell0 Aug 24 06:42:31.328006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writer thread running {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.333083 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_db.sqlalchemy.engines [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:42:31.337452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writer thread running {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:42:31.648703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: WARNING keystonemiddleware.auth_token [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:42:31.656297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: WARNING keystonemiddleware.auth_token [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:42:31.656744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: WARNING keystonemiddleware.auth_token [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:42:31.664195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: WARNING keystonemiddleware.auth_token [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:42:32.010196 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: WARNING keystonemiddleware.auth_token [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:42:32.014404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: WARNING keystonemiddleware.auth_token [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:42:32.017237 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: WARNING keystonemiddleware.auth_token [None req-ee36700a-3162-455f-9d11-8c17477b1c0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:42:32.020950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: WARNING keystonemiddleware.auth_token [None req-539a5371-7f75-4a17-b60c-7a119667541e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:42:32.022649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faf642d9c0 pid: 127291 (default app) Aug 24 06:42:32.026360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55faf642d9c0 pid: 127290 (default app) Aug 24 06:43:08.367911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:08.370026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:08.371109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:08.372148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:09.525486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e6b30d5a-4218-4136-8fb1-43464c7a19a5 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Action: 'create', calling method: .version_select at 0x7f3dca668700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1156864533", "metadata": {"Type": "work"}}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:10.998939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e6b30d5a-4218-4136-8fb1-43464c7a19a5 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.653599 Aug 24 06:43:11.000527 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 06:43:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2657 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:43:11.015723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9b902686-a797-4a1a-b4c9-d22fbdeb0ba3 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca53c550>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:11.175682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9b902686-a797-4a1a-b4c9-d22fbdeb0ba3 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 200 len: 353 microversion: 2.1 time: 0.138703 Aug 24 06:43:11.175682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:11 2022] GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 353 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:11.338452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a73c7cb8-a94a-4631-882f-a5699c220d11 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca7981f0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:11.391146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:11.392340 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:11.394046 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:11.395290 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:11.915699 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a73c7cb8-a94a-4631-882f-a5699c220d11 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/07c88d0a-7f09-464a-995f-3aab61212fc5" status: 200 len: 350 microversion: 2.1 time: 1.096411 Aug 24 06:43:11.916751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:10 2022] GET /compute/v2.1/os-volumes/07c88d0a-7f09-464a-995f-3aab61212fc5 => generated 350 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:12.164488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9594eb06-8695-4d83-9a9c-d3fa02b35ac4 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca53cc10>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:12.285271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9594eb06-8695-4d83-9a9c-d3fa02b35ac4 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 200 len: 354 microversion: 2.1 time: 0.125175 Aug 24 06:43:12.293300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:12 2022] GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:12.301197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7c8519b6-04f4-44bd-a25d-0402a8d8e105 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca5a0550>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:12.428202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7c8519b6-04f4-44bd-a25d-0402a8d8e105 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 200 len: 354 microversion: 2.1 time: 0.133286 Aug 24 06:43:12.431670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 2/5] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:12 2022] GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:12.463064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-eef4b891-4233-4353-8e94-07c18c736d0e tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca554310>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:12.703674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-eef4b891-4233-4353-8e94-07c18c736d0e tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 202 len: 0 microversion: 2.1 time: 0.251682 Aug 24 06:43:12.705195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 4/6] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:43:12 2022] DELETE /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:43:12.715773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-499bb634-7dd7-4dea-a3f6-6f11a4ce721a tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca5a04c0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:12.831899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-499bb634-7dd7-4dea-a3f6-6f11a4ce721a tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 200 len: 353 microversion: 2.1 time: 0.122790 Aug 24 06:43:12.833022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:12 2022] GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:13.679870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9e0784cc-d17c-4395-b978-980870e2f935 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53cc10>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:13.790297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9e0784cc-d17c-4395-b978-980870e2f935 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7a62fbcb-ee01-48c8-ac8d-8e4730d72d6c" status: 200 len: 351 microversion: 2.1 time: 0.115232 Aug 24 06:43:13.791546 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:13 2022] GET /compute/v2.1/os-volumes/7a62fbcb-ee01-48c8-ac8d-8e4730d72d6c => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:13.847954 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d4a99d6f-cc97-46e1-b63a-e12c9c723d79 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Calling method '.version_select at 0x7f3dca5a0d30>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:13.915767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-d4a99d6f-cc97-46e1-b63a-e12c9c723d79 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] HTTP exception thrown: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d4a99d6f-cc97-46e1-b63a-e12c9c723d79 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Request method failure captured: Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 HTTP/1.1 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBch8ASZ7Ah5yFSBKookhgQ1CUMdPozTHloYOSn_cb2oET-bhnMTLNLj8xDmFqeTJtTWvH8vD4DXki-niPZTKnQ9q3OUdjGTOkunjQHGEHTNu7nNZqVrXfyd8BsMk1BfpLua8POTbxbo_zbXaAModPWRAJNzwDv24lysvOdGq5LkYnSg Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 16c7f1d71bf24c558c566f71aa177447 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesGetTestJSON-1676261496 Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:43:13.920645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16c7f1d71bf24c558c566f71aa177447"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_16c7f1d71bf24c558c566f71aa177447", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/16c7f1d71bf24c558c566f71aa177447"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/16c7f1d71bf24c558c566f71aa177447"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesGetTestJSON-1676261496 Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 16c7f1d71bf24c558c566f71aa177447 Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesGetTestJSON-1676261496 Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesGetTestJSON-1676261496-project Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 1f345e623d524d868cfa3115ff5411bf Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesGetTestJSON-1676261496-project Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '080f69c1-8c0c-4240-8340-fd412ae4b914'} Aug 24 06:43:13.921867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. (HTTP 404) (Request-ID: req-398fd8c2-3345-42fb-a38d-776c77dfaa28) Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:43:13.922505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:43:13.923476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:43:13.924402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d4a99d6f-cc97-46e1-b63a-e12c9c723d79 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] Returning 404 to user: Volume 080f69c1-8c0c-4240-8340-fd412ae4b914 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d4a99d6f-cc97-46e1-b63a-e12c9c723d79 tempest-VolumesGetTestJSON-1676261496 tempest-VolumesGetTestJSON-1676261496-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914" status: 404 len: 109 microversion: 2.1 time: 0.078550 Aug 24 06:43:13.925281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 4/9] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:13 2022] GET /compute/v2.1/os-volumes/080f69c1-8c0c-4240-8340-fd412ae4b914 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:43:16.444183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4d4adc5c-7adf-4e85-81ce-a83478475486 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53c4c0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:16.561356 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4d4adc5c-7adf-4e85-81ce-a83478475486 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/44ac0b7e-53ad-453b-b335-50e487fa9863" status: 200 len: 350 microversion: 2.1 time: 0.120896 Aug 24 06:43:16.562503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 6/10] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:43:16 2022] GET /compute/v2.1/os-volumes/44ac0b7e-53ad-453b-b335-50e487fa9863 => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:16.576034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8325ec45-89ff-4bcf-8d40-582f2dafb04a tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53edc0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:16.906692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8325ec45-89ff-4bcf-8d40-582f2dafb04a tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.335259 Aug 24 06:43:16.907278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 5/11] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 24 06:43:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:16.922030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c27e9b20-9734-4e14-959f-6944bcbdf359 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca5544c0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:17.150671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c27e9b20-9734-4e14-959f-6944bcbdf359 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.232482 Aug 24 06:43:17.151437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 7/12] 10.222.0.52 () {58 vars in 1149 bytes} [Wed Aug 24 06:43:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:17.166166 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-68e65c29-6a41-4492-abcb-e6d2c6f952f3 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53e8b0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:17.401289 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-68e65c29-6a41-4492-abcb-e6d2c6f952f3 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.239591 Aug 24 06:43:17.411085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 6/13] 10.222.0.52 () {58 vars in 1134 bytes} [Wed Aug 24 06:43:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:17.418844 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1b5aa6e3-4142-4205-995f-c08ce79cc5e9 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca554e50>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:17.725962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1b5aa6e3-4142-4205-995f-c08ce79cc5e9 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.313841 Aug 24 06:43:17.726600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 8/14] 10.222.0.52 () {58 vars in 1167 bytes} [Wed Aug 24 06:43:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:17.740862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-87bcf3ec-ff9d-4c6e-b4f6-4c688656104a tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53c5e0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.058347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-87bcf3ec-ff9d-4c6e-b4f6-4c688656104a tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.320735 Aug 24 06:43:18.068895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 9/15] 10.222.0.52 () {58 vars in 1170 bytes} [Wed Aug 24 06:43:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:18.075513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bd6214e6-f998-4dac-a277-e53fa6f05cf1 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca55f940>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.137281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-037c6476-2e25-4e71-bae9-d76544a0196a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: .version_select at 0x7f3dca51e430>, body: {"keypair": {"name": "tempest-keypair-1306290246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXDOVFNDxlrZfGNlFE+72dL1xkSJ3WpMN3YRGL9aNCDsyMhljutqrYHbdSz6+Hp7Vv8JYfOwO4rwMvpURdV9VI/8D1sfhqW0+2+CPDAab6LHrp941d9eY9bymCbn9e8PA=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:18.257996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-037c6476-2e25-4e71-bae9-d76544a0196a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:18.291623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-037c6476-2e25-4e71-bae9-d76544a0196a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:18.394376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bd6214e6-f998-4dac-a277-e53fa6f05cf1 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.322673 Aug 24 06:43:18.403300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 24 06:43:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:18.414835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bc7ec854-42a6-490a-a4ac-65396ba48664 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca53cee0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.433903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-037c6476-2e25-4e71-bae9-d76544a0196a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.997467 Aug 24 06:43:18.434900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 7/17] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:43:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:18.552154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bc7ec854-42a6-490a-a4ac-65396ba48664 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.147483 Aug 24 06:43:18.553435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 11/18] 10.222.0.52 () {58 vars in 1188 bytes} [Wed Aug 24 06:43:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:18.568752 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-56c12eae-efb4-4632-bf7d-4e0af1750908 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] Calling method '.version_select at 0x7f3dca4823a0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:18.757081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-56c12eae-efb4-4632-bf7d-4e0af1750908 tempest-VolumesTestJSON-1333481694 tempest-VolumesTestJSON-1333481694-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.192473 Aug 24 06:43:18.759292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 8/19] 10.222.0.52 () {58 vars in 1155 bytes} [Wed Aug 24 06:43:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:24.570288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-502965822", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:24.797112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] validate_networks() for [('4ee4b0b1-e8df-4c0b-bdee-5bdfdfc628ad', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:27.185919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:27.186540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:27.187275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:27.188111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:27.189116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:27.235264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.235881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.236192 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:27.237238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:27.238616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:27.240539 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:27.301627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:27.311309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for user 2c917c21c7974c8d9746e8b05d9c8b9f and project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:27.328391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:27.340695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:27.613074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e3c86e97-4d5e-489f-afd0-f28b4c1632a1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.345661 Aug 24 06:43:27.627718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d1ad04f7-6b52-401e-b689-f6e981163a36 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:27.628632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 12/20] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:27.629774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d1ad04f7-6b52-401e-b689-f6e981163a36 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:28.096289 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1ad04f7-6b52-401e-b689-f6e981163a36 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:28.138267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d1ad04f7-6b52-401e-b689-f6e981163a36 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1221 microversion: 2.1 time: 0.505581 Aug 24 06:43:28.139322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 9/21] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:27 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1221 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:28.748674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-240298604", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "networks": [{"uuid": "29ff322a-6eb8-436a-953a-aa176e35076e"}]}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:28.837798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] validate_networks() for [('29ff322a-6eb8-436a-953a-aa176e35076e', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:28.892059 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1005153290", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:29.071351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] validate_networks() for [('4ee4b0b1-e8df-4c0b-bdee-5bdfdfc628ad', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:29.930444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:29.932296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:29.932956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:29.933596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:29.934278 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:29.953670 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:29.956531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:29.956964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:29.958547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:29.961548 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:29.962117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:30.010081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Getting quotas for project 59b7ab43f7824f6c8a17988db2a25807. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:30.023116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Getting quotas for user 7f3061468e644588a9f7f8de2af94827 and project 59b7ab43f7824f6c8a17988db2a25807. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:30.060200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:30.068030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:30.201103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f1a34534-1db9-42e6-91a8-632cd49777a1 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.270607 Aug 24 06:43:30.201812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 13/22] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:43:30.223147 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1571850497", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d764327-7285-4015-bbe3-ebfc93ab6200"}], "security_groups": [{"name": "tempest-securitygroup--1068599345"}], "key_name": "tempest-keypair-1306290246", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:30.753407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] validate_networks() for [('4d764327-7285-4015-bbe3-ebfc93ab6200', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:31.458598 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:31.459631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:31.460267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:31.460827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:31.461383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:31.484099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.489525 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.490238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.491854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:31.497456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:31.501901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:31.617951 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:31.639770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for user 2c917c21c7974c8d9746e8b05d9c8b9f and project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:31.680822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:31.696741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:31.938770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-da9d4e88-de06-49e4-84ee-197d5ff8080a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.055081 Aug 24 06:43:31.939884 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 10/23] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:32.137335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:32.138951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:32.139826 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:32.140262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:32.140898 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:32.161033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.163495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.165171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.166246 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:32.167021 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:32.167898 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:32.275724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:32.281569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:32.302735 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:32.308930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:32.409306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-745f0144-dda3-4fc9-90d6-d577412e73b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.204996 Aug 24 06:43:32.410762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 14/24] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:32.896467 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f0bf2145-ab4d-47ea-b264-4dafefa4cca3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: .version_select at 0x7f3dc9b79b80>, body: {"keypair": {"name": "tempest-keypair-1154689060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmf9L3YQdtsop3CUMSbWflcRKg1yS42BIkmhkaNPD3uEwrd8rZHB3Iu2Yc8VEly233/POa3znj1dkAHxDc3dispdklVv4rky4NtMZs8Kk9YK/TU3TC4I5Z0jlJb+4VhoA=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:32.984770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f0bf2145-ab4d-47ea-b264-4dafefa4cca3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:33.001403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f0bf2145-ab4d-47ea-b264-4dafefa4cca3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for user 1d26cf886087408097cc2e435a785454 and project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:33.084205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f0bf2145-ab4d-47ea-b264-4dafefa4cca3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.141617 Aug 24 06:43:33.085538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 11/25] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:43:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:33.094193 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:33.096262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:33.106492 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.107369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.108081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:33.109106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.109970 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.110579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:33.302096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-22520144-03fa-40c5-81a1-1b3e98675f59 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: .version_select at 0x7f3dca53cd30>, body: {"keypair": {"name": "tempest-keypair-992223648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqJrL88yWFhKAQWbaqco4UdsRzDMjBQuEtFKfD4uWNBToLjzhNjfJ5OM2x0WVAuWJ0yEn8weAeK26cZutw2L8kXbG8GS++/Rf1++xG4ArfHEeZbsLh+DEyEbtqPOMBsVg=="}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:33.430421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-22520144-03fa-40c5-81a1-1b3e98675f59 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:33.458435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-22520144-03fa-40c5-81a1-1b3e98675f59 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for user bfb5dc1fa16f465ba1ebca000b665d46 and project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:33.618334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-22520144-03fa-40c5-81a1-1b3e98675f59 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.205965 Aug 24 06:43:33.619457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 15/26] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 24 06:43:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1208 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 06:43:33.629280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:33.630538 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:33.687689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.703006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.704685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:33.708180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:33.711166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:33.714620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.233574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:34.261059 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-696edf3d-78dc-4246-b530-d4c3fe94dcf2 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1210 microversion: 2.1 time: 1.174168 Aug 24 06:43:34.267788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 12/27] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:33 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1210 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:34.278559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:34.283659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:34.306135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.307268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.308979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.310861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:34.311521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:34.314804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:34.801299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:34.834434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-088f718f-c2f9-474d-bfb9-047eb1410668 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1218 microversion: 2.1 time: 1.211831 Aug 24 06:43:34.841226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 16/28] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:33 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1218 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:34.867936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:34.896124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-318e1f0b-6841-4354-ac1d-69f83e9514e7 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1246 microversion: 2.1 time: 0.620323 Aug 24 06:43:34.898162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 13/29] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:34 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1246 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:35.298387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:35.299010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:35.310049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.324222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.325895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.327876 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.330112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.333606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.867869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:35.869331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:35.886308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.888865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.890828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.893450 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:35.904269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:35.905076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:35.993934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:36.008981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-64440b09-b0ec-4784-984a-7f4ffe6d22d8 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1272 microversion: 2.1 time: 0.716481 Aug 24 06:43:36.011363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 17/30] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:35 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1272 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:36.043429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:36.050706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:36.083473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.086134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.086947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:36.091038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:36.092253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:36.095389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.333051 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:37.351692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e4768005-53b5-4de2-a016-000adb7856ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1312 microversion: 2.1 time: 1.338268 Aug 24 06:43:37.363413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 18/31] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:36 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1312 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:37.393251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:37.396619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:37.438002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.438517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.441877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.444701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.455427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:37.463533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.464688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.470249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0d816dcd-e2f0-460f-abac-8730fe89ec54 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1292 microversion: 2.1 time: 1.604569 Aug 24 06:43:37.477490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 14/32] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:35 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1292 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:37.848079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:37.866821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7b09fd7e-3af6-4818-a00e-515c5c2ea67c tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1272 microversion: 2.1 time: 0.496875 Aug 24 06:43:37.868653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 19/33] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:37 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1272 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:38.391507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:38.392673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:38.417009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.421052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.423837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.430036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.432230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.436343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.495440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:38.496944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:38.514592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.520319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.522450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.529238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:38.530068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:38.531724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:38.868428 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:38.893169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6767310f-7e33-4096-aa58-9a04fb652d5c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1300 microversion: 2.1 time: 0.508182 Aug 24 06:43:38.895293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 15/34] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:38 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1300 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:38.949782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:38.952383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:38.989373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.000578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.006508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.008084 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.008978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.010566 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.207640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:39.231872 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-35ab979d-9fab-4d51-b302-3f403776dc78 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1280 microversion: 2.1 time: 0.740213 Aug 24 06:43:39.266878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 20/35] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:38 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1280 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:39.514160 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:39.522525 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-795aca48-5bbb-49ca-b892-bfb5020f9574 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1272 microversion: 2.1 time: 0.623193 Aug 24 06:43:39.523317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 16/36] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:38 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1272 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:39.928563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:39.929695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:39.946095 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.949099 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.956482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:39.961064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:39.964628 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:39.966034 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:40.264450 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:40.265063 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:40.288273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.288779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.310313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:40.311254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:40.316720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:40.317390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.252267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:41.276559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1a147bcc-d12f-4fbd-9ea1-12616e7b530c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1280 microversion: 2.1 time: 1.017821 Aug 24 06:43:41.280483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 17/37] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:40 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1280 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:41.298068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:41.302136 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:41.315936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.320628 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.323230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.326051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:41.326915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:41.329165 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:41.594033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:42.201236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.224137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6c884e1b-2ed8-454d-ba60-9488ba87a62a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 2.299186 Aug 24 06:43:42.225797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 21/38] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:39 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 2302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:42.304608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:42.305515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:42.309783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:42.332352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.334274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.334765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.335622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:42.336040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:42.342482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:42.653526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.662838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2b336bab-cb85-4223-8397-dfe4831f420c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1280 microversion: 2.1 time: 0.364174 Aug 24 06:43:42.671307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 22/39] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:42 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1280 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:42.753755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:42.778886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f81976d4-ac75-4367-9e60-aa625f777d2a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 1.488316 Aug 24 06:43:42.799814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 18/40] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:41 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:43.256959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:43.260175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:43.283541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.284525 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.285998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.287038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.287725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.288969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.481345 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=22 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:43.593074 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1502848846", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "018b0e35-de97-44eb-a1bf-77de9b3c6286"}], "security_groups": [{"name": "tempest-securitygroup--2034829104"}], "key_name": "tempest-keypair-1154689060", "user_data": "}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:43.631412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=16 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:43.644445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=5 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:43.887276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:43.916208 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ffd52650-ab19-48de-8e1b-f836df52bf62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.671613 Aug 24 06:43:43.917103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 23/41] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:43 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:43.926355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:43.930981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:43.946988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.947982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.948706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:43.951448 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:43.954102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:43.954834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:44.230121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] validate_networks() for [('018b0e35-de97-44eb-a1bf-77de9b3c6286', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:45.875590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:45.892721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d8c3adc7-a21f-4ae0-93d2-2e97c5437821 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 1.974286 Aug 24 06:43:45.895786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 24/42] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:43 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:45.918487 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:45.919699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:45.944655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.948375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.949650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:45.953307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:45.954822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:45.958005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.365025 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:46.378815 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-589f732d-a6c0-49f7-b7b9-512e8521adc3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.476291 Aug 24 06:43:46.380641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 25/43] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:45 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:46.391289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:46.394478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:46.408665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.413491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.414549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:46.415948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:46.419918 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:46.420801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.692694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:47.700296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b4d7be46-1930-45a8-8ec0-1525c0b5523c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 1.316972 Aug 24 06:43:47.702254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 26/44] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:46 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:47.731130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:47.740809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:47.758537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.759742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.760361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:47.761224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:47.764424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:47.765104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.040360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:48.044749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:48.050300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:48.052892 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:48.053546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:48.118445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.119934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.125858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.128294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.129804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.134309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.181665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:48.191296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for user 1d26cf886087408097cc2e435a785454 and project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:48.212128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:48.219167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:48.292729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f1ecfd98-fa45-410e-87cb-bdfdef1652cc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.705672 Aug 24 06:43:48.294104 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 19/45] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:43:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 4708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:43:48.300620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:48.301663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:48.330090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.331899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.335066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.338829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:48.340590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:48.341604 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:48.707077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:48.710444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=77 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:48.736852 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e661cad7-106c-4788-baf4-325aa31b9424 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 1.031944 Aug 24 06:43:48.737495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 27/46] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:47 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:48.752682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-412151748", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be3c841-0d59-4803-979e-08c48130dbdb"}], "security_groups": [{"name": "tempest-securitygroup--2013716148"}], "key_name": "tempest-keypair-992223648", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:48.770423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:48.810762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:48.820557 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-69da1619-1c33-471f-98c7-1275b37cc545 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.524725 Aug 24 06:43:48.837822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 20/47] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:48 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:48.852344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-31711421-29fb-4da0-9674-b55e5451719a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:48.853042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-31711421-29fb-4da0-9674-b55e5451719a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:49.047686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-31711421-29fb-4da0-9674-b55e5451719a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:49.059308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-31711421-29fb-4da0-9674-b55e5451719a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1238 microversion: 2.1 time: 0.219984 Aug 24 06:43:49.072315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 21/48] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:48 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1238 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:49.085024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:49.086508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:49.100483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.101883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.105307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.107168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:49.108633 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:49.110485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:49.471728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] validate_networks() for [('8be3c841-0d59-4803-979e-08c48130dbdb', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:43:50.159007 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:50.171744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1ad6f2cd-ce13-4f8a-b508-22e3c296a5de tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 1.098093 Aug 24 06:43:50.184007 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:49 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:50.514513 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eddb672-d1fa-40ab-8cae-6e148b2e01ab", "tag": "6325096c-829d-49a5-ab4d-26363e83141d"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:50.553972 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.554791 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.556487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.617305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Creating event network-changed:6325096c-829d-49a5-ab4d-26363e83141d for instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab on hv-cinder-85427 Aug 24 06:43:50.618037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127290) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:43:50.618527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e866acf4-b914-43f4-96af-1564a32d032b req-9ee3908f-ca09-4f9f-a24a-0e2fd4de3962 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127290) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:43:50.619712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.620183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.620623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.621347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.622051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.622498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.642966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.compute.rpcapi [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:43:50.649556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] Releasing lock "compute-rpcapi-router" {{(pid=127290) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:43:50.695868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ae9a4bcc-f408-46b8-90d5-ad30bec6c16d None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.505839 Aug 24 06:43:50.696833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 23/50] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:50.798415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:43:50.799031 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:43:50.799326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:43:50.799945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:43:50.800606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:43:50.824326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.826994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.827485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.830980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:50.831521 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:50.831954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:50.889639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:43:50.898170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for user bfb5dc1fa16f465ba1ebca000b665d46 and project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:43:50.929791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:43:50.934402 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:43:51.054696 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-69c19aa2-bfd5-4c89-ba4b-a0af3ec392c5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.314666 Aug 24 06:43:51.059730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 28/51] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 24 06:43:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 06:43:51.081260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.098623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.119274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.129858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.130299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.133039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.133511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.133943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.315503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8a1bf0-8a43-4089-b507-6dba65b29948", "tag": "c8eba2b0-b09a-4bae-9f7b-feefb9b58a05"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:51.330419 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.331020 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.332782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.359572 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] Creating event network-changed:c8eba2b0-b09a-4bae-9f7b-feefb9b58a05 for instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 on hv-cinder-85427 Aug 24 06:43:51.373531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-05cb9fd6-530e-4bb5-b304-b391a1460e7c req-943a5415-cb60-4a43-97ba-e94ab5e17b23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.672289 Aug 24 06:43:51.375228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 24/52] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:51.389006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.389736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.405973 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.409279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.409782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.410554 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.411015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.415369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.687395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.696572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-16b056fd-d7b9-4e69-97ba-62c62815b90e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.635514 Aug 24 06:43:51.697282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 29/53] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:51.701809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.702431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.725490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.725998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.733026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.733960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.734595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.735037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.839626 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.847107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:51.854219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6e8f5d6d-4f25-4c9f-9a77-bcc6e76999bb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1296 microversion: 2.1 time: 0.155593 Aug 24 06:43:51.854709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 30/54] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1296 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:51.867592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3acd4bef-2842-4b32-9ccf-6de3e3e631f4 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.480406 Aug 24 06:43:51.867592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 25/55] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:51.872707 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.873182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:51.873311 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.873803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:51.880342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.881098 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.881711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.882258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.882756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.883223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.883389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.884270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:51.884871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.884981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:51.885490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.886011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:51.997747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.012213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.013719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.018599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ec0eeff2-8125-4b73-bb00-5acda9c9bd89 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1284 microversion: 2.20 time: 0.160369 Aug 24 06:43:52.020514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 31/56] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:52.100761 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:52.111182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-24320fc9-b621-496d-8d04-c1e95169db39 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.251944 Aug 24 06:43:52.123315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 26/57] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:51 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:52.720534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.721993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.738566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.746274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.746851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.747913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.755103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.755556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.785441 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aec55df-6956-4258-81c9-469249e92ee8", "tag": "3ac81731-4203-4914-a5b4-e0429c7bf9e1"}, {"name": "network-changed", "server_uuid": "c37ed41f-655a-4350-8028-3ffb0012a366", "tag": "3a7756a4-6904-4669-84c1-c44620572080"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:52.803856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.804339 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.804760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.835317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Creating event network-changed:3ac81731-4203-4914-a5b4-e0429c7bf9e1 for instance 9aec55df-6956-4258-81c9-469249e92ee8 on hv-cinder-85427 Aug 24 06:43:52.835900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] Creating event network-changed:3a7756a4-6904-4669-84c1-c44620572080 for instance c37ed41f-655a-4350-8028-3ffb0012a366 on hv-cinder-85427 Aug 24 06:43:52.852747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-41401cdd-571e-4e98-8dd7-209a7488b67c req-3c9bd4dc-c726-45f8-8066-e35d73a265da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071991 Aug 24 06:43:52.856350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 27/58] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:52.878824 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:52.879507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:52.896714 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.897216 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.897657 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:52.898365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:52.898827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:52.899279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.014921 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.024569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-217441e6-6209-4b2a-b5c9-6bba8cb06476 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1296 microversion: 2.1 time: 0.150168 Aug 24 06:43:53.025205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1296 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:53.057584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:53.059102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:53.074365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.074945 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.075483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.077360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.079807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.083799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.086161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.097132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e31f4b4f-f3e0-4eba-b91a-64fc8691c378 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.380576 Aug 24 06:43:53.099399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 32/60] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:52 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:53.110424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:53.111049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:53.124729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.125224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.125646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.126362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.126812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.127255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.255355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.276162 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.280270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.281455 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f7e78c58-f242-4a24-80ef-1ecca590eaf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1276 microversion: 2.20 time: 0.181098 Aug 24 06:43:53.284282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 33/61] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:53 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:53.306102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:53.308249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:53.351798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.355183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.356602 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.359851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:53.360551 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:53.360994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:53.361639 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.374169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5eb9d717-5c8e-42ce-b9a4-1681190855ab tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.333274 Aug 24 06:43:53.375329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 29/62] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:53 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:53.583683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:53.593871 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ac1f7e82-913a-4559-9b19-5a5448060edf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.308324 Aug 24 06:43:53.594609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 34/63] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:53 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:54.046276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.047131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.053275 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.053768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.054208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.054918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.055409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.056173 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.120299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.121197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.138406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.139204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.139657 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.140383 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.140840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.141606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.364556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.372654 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-32b6a817-d149-4065-8e1c-4376f290f573 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.330605 Aug 24 06:43:54.373238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 30/64] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:54.386697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.387655 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.399518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.402625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.403302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.404184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.404808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.406504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.490732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.519038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2401bf49-6b3b-4c13-a33a-03d5242c679f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.402911 Aug 24 06:43:54.532043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 35/65] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:54.549459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=100 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:54.555297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.555940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.589248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.589756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.590203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.593633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.594369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.595919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.758693 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.775050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.776620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:54.777750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d687517d-7675-4a32-9a50-830ac49648a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1332 microversion: 2.20 time: 0.400267 Aug 24 06:43:54.779355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 31/66] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1332 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:54.793030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:54.793650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:54.800748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.801234 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.804153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:54.805222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:54.807132 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:54.810874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.232665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:55.260530 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1be63f3f-d09c-4375-981d-456e5b07c28b tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.727333 Aug 24 06:43:55.267741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 36/67] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:55.378518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:55.394473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5457bd20-e85b-4b34-9074-a62fc619a321 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.614000 Aug 24 06:43:55.395090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 32/68] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:54 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:55.404689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:55.410213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:55.417001 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.417773 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.418412 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.419305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.419818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.420243 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.554845 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:55.555868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:55.564680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.565637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.566483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.567668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:55.568405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:55.568998 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:55.999041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.012112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6b088505-ccf2-4438-a6bf-0ef309af81e2 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.621128 Aug 24 06:43:56.013819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 37/69] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:55 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:56.020049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:56.022809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:56.026683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.036220 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-592cfd9c-39dc-45c2-97e9-a614124d3765 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.486475 Aug 24 06:43:56.041613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 33/70] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:55 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:56.059413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.074760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.076967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.082421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.083079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.083783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.268485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.283326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.286655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.289009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:56.289585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-febe2105-b289-4021-a13a-bd7b3924dbf6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1338 microversion: 2.20 time: 0.273837 Aug 24 06:43:56.289711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:56.292471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 38/71] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:56 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1338 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:56.297746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.298236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.298667 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.299405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.299852 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.300506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.421427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:56.421427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:56.435497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.438809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.442150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.443093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.443762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.444354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.879299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.894613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-25903f51-64a1-41a1-8eed-a5424638a9e3 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.606761 Aug 24 06:43:56.908458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 34/72] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:56 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:56.908458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab5d31b-1a4a-4ca9-999c-f8b06b7660f6", "tag": "454b34ae-8fe5-46de-9bae-481f3ada5897"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:56.935720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:56.938622 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:56.940821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:56.953041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:56.968202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b735ecd9-b818-47f8-a915-9cf576c0cef4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.552070 Aug 24 06:43:56.968860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 39/73] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:56 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:56.972353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] Creating event network-changed:454b34ae-8fe5-46de-9bae-481f3ada5897 for instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 on hv-cinder-85427 Aug 24 06:43:56.987923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-de5e35c4-fadd-4baa-8b1f-1887955e76a7 req-16e00ac4-f7c4-44bb-80a2-f8edd42e562f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090338 Aug 24 06:43:56.988840 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 35/74] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:57.035141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.035821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.051971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.053561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.054526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.056606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.059163 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.063846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.064639 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.066517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.082916 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.084134 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.086889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.091279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.094596 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.095480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.523969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.533139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6aa45fcb-62e2-4e76-847e-205f6adb92b5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.503071 Aug 24 06:43:57.534003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 40/75] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:57.538818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.539726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.547348 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.548550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.549256 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.550247 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.550896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.551643 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.576041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.600290 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8e8d8d08-9c89-4f29-9e1a-4600a6fc6180 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.543531 Aug 24 06:43:57.601602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 36/76] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:57.915568 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.916244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:57.941419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.943619 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.944345 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.945236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.947374 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:57.948414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:57.949417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:57.955967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.964737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:57.965984 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0cfa6284-7138-4269-9024-1bcf164a4498 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.430809 Aug 24 06:43:57.984306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 41/77] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:57.990721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:57.991371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:58.005681 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.006182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.006612 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.011219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.011786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.013088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.405453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:58.418013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4747aead-7a40-4ed9-9dbb-73c877b84a64 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.506528 Aug 24 06:43:58.431584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 37/78] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:43:58.485053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:58.504346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a50e8f7b-750a-45a3-8ee5-4c0db551d95b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.518040 Aug 24 06:43:58.506390 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 42/79] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:57 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:58.554877 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:58.556023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:58.565784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.566376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.566955 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.568344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.568959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.569578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.622435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:58.623632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:58.634639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.643687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.644150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.644939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.645533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.645976 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.934351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:58.950120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-67dd894a-6b6b-4c26-b1e5-ebafe1161532 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.399075 Aug 24 06:43:58.952058 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 38/80] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:58 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:58.956944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:58.972115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:58.973097 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:58.974483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:58.992145 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] Creating event network-changed:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:43:59.000660 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-c0da0a0d-bcad-4038-b7f3-70be9d2bbdf0 req-94b7ecfd-d1d9-4d96-9053-faaf45087a58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047177 Aug 24 06:43:59.002382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 39/81] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:59.013148 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:59.014099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:59.026252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.027913 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.028508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.029380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.030459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.031228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.049490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.062940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-305cad0e-755b-42e2-9aad-fdc780b65067 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.444235 Aug 24 06:43:59.080240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=8 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:59.093895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 43/82] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:58 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:43:59.515980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eddb672-d1fa-40ab-8cae-6e148b2e01ab", "name": "network-vif-plugged", "status": "completed", "tag": "6325096c-829d-49a5-ab4d-26363e83141d"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:59.575044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.575627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.579381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.640817 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Creating event network-vif-plugged:6325096c-829d-49a5-ab4d-26363e83141d for instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab on hv-cinder-85427 Aug 24 06:43:59.643350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127291) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:43:59.643764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0ccfcbab-3a86-46a0-bb9e-71c9ea0fc2a2 req-c99809a6-9412-4bd9-bfd4-78f2a6a78c0b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127291) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:43:59.644887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.645491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.645942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.652348 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.653009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.657952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.676722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.compute.rpcapi [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:43:59.679381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] Releasing lock "compute-rpcapi-router" {{(pid=127291) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:43:59.729927 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9cc0ce30-7b72-4638-83fd-541cb074fb09 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.459802 Aug 24 06:43:59.731431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 44/83] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:43:59.738175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:59.738986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:59.749920 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.750638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.751378 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.752362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.753120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.753754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.788227 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:59.828060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.857179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.859749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:43:59.860909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ce050377-9bd2-4db1-820b-4cbd1e1e61cf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.856923 Aug 24 06:43:59.861507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 40/84] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:43:59 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:43:59.874362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:43:59.875159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:43:59.911541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.912040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.912510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:59.913298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:59.913650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:59.914076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.089973 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.108087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5ca3dcb0-976f-4dce-a129-21875ee4eb7a tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.375341 Aug 24 06:44:00.109124 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 45/85] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:59 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:00.114299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:00.115644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:00.122949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.123485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.124047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.124832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.125316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.125743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.178854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.188816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1176b497-6a9c-476b-9bac-2fd4b5f1710e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.318343 Aug 24 06:44:00.189413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 41/86] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:43:59 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:00.193895 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:00.194727 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:00.200761 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.201445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.201892 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.202602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.203065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.203520 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.356411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.364618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b7b3cf91-4bc2-475b-9f5c-48ba6aba429a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.254171 Aug 24 06:44:00.365900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 46/87] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:00 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:00.408850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:00.416985 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-59d421c2-5e99-49fa-85fe-ab7f90fc3bb1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.226540 Aug 24 06:44:00.430306 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 42/88] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:00 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:00.885616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:00.890554 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:00.908610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.910545 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.913306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.914369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:00.915111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:00.916905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:00.918641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:01.132064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.133265 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.137018 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:01.141111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.153503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.155233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.157257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.160134 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.160861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.218490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.230849 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.232408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.237359 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cf11ba2b-1648-4ef5-bd54-f71c99bb941b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.356863 Aug 24 06:44:01.238303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 47/89] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:00 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:01.245663 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.252023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.270927 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.271672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.272055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.280047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.280047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.280047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.549836 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.562527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-717bdd5a-9e66-4747-815e-e7ddc1ab466f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.434972 Aug 24 06:44:01.566162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 43/90] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:01.581680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.583041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.590540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.591908 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.592830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.593899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.594551 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.595215 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.609302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.619906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-11d6b92c-9420-466b-8a75-7301d9476126 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.379071 Aug 24 06:44:01.620795 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 48/91] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:01.627744 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:01.629113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:01.637376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.638220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.638857 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.640261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.641035 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.641647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.835570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.844376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-de153e6f-c176-4c23-bfd0-e38501939702 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.274663 Aug 24 06:44:01.845082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 44/92] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:01.861923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:01.865171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aec55df-6956-4258-81c9-469249e92ee8", "name": "network-vif-plugged", "status": "completed", "tag": "3ac81731-4203-4914-a5b4-e0429c7bf9e1"}, {"server_uuid": "8c8a1bf0-8a43-4089-b507-6dba65b29948", "name": "network-vif-plugged", "status": "completed", "tag": "c8eba2b0-b09a-4bae-9f7b-feefb9b58a05"}, {"server_uuid": "c37ed41f-655a-4350-8028-3ffb0012a366", "name": "network-vif-plugged", "status": "completed", "tag": "3a7756a4-6904-4669-84c1-c44620572080"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:01.866149 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9458c717-aa78-49bb-90db-d466cd230b3f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.243898 Aug 24 06:44:01.877288 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:01.877856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:01.878140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 49/93] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:01 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:01.878245 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:01.894580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Creating event network-vif-plugged:3ac81731-4203-4914-a5b4-e0429c7bf9e1 for instance 9aec55df-6956-4258-81c9-469249e92ee8 on hv-cinder-85427 Aug 24 06:44:01.895208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Creating event network-vif-plugged:c8eba2b0-b09a-4bae-9f7b-feefb9b58a05 for instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 on hv-cinder-85427 Aug 24 06:44:01.895937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] Creating event network-vif-plugged:3a7756a4-6904-4669-84c1-c44620572080 for instance c37ed41f-655a-4350-8028-3ffb0012a366 on hv-cinder-85427 Aug 24 06:44:01.905472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-458d187b-641c-4246-9760-531b20f97283 req-9e6a4630-9461-4eb7-8949-52c2faaa8129 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048602 Aug 24 06:44:01.906329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 45/94] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:02.267248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.268673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.274989 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.275609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.276119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.276929 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.277497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.278024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.591387 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.592292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.607650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.608377 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.609821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.611415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.612877 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.613740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.639623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.655744 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.657832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.658979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-06f61c1e-717c-4bc7-a83c-43ff7a764c6f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.395664 Aug 24 06:44:02.664152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 50/95] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:02.670306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.670930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.690237 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.690733 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.691178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.691910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.692372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.692799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.944547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.956080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-645375ab-7a86-47a5-bd7d-0df0485fd5cb tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1314 microversion: 2.1 time: 0.370910 Aug 24 06:44:02.970278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 46/96] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:02.970403 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:02.982891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b1330b44-0097-4d8f-aa99-ca43cc56e9ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1368 microversion: 2.1 time: 0.316797 Aug 24 06:44:02.982891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 51/97] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:02.983593 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.986776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.994495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.995694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.996098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:02.996305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:02.996753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:02.997017 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:02.997602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:02.998027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.003767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.004266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.004694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.005394 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.005853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.006474 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.282817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.286161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.298242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-429ffc19-c73f-4a3c-9bd1-7d5ad05ac29c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.309282 Aug 24 06:44:03.301239 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d8a518b9-8860-446f-985d-39d6363a4110 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.329956 Aug 24 06:44:03.301850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 47/98] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:03.316204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 52/99] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:02 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:03.693131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:03.693778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:03.700783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.701267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.701700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.707045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.707780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.708326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.864081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.874796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.877425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:03.878777 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-38c9fdf7-33d6-4104-8f3f-3b58def91783 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.190263 Aug 24 06:44:03.879481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 48/100] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:03.923549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab5d31b-1a4a-4ca9-999c-f8b06b7660f6", "name": "network-vif-plugged", "status": "completed", "tag": "454b34ae-8fe5-46de-9bae-481f3ada5897"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:03.935722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.936223 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.936961 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.951464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] Creating event network-vif-plugged:454b34ae-8fe5-46de-9bae-481f3ada5897 for instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 on hv-cinder-85427 Aug 24 06:44:03.959424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-2560d7eb-86f2-4c23-b643-916296e30e36 req-ea8fcfb7-fa5a-4d59-921f-d7bcad3693f2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039780 Aug 24 06:44:03.963871 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 53/101] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:03.977841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:03.978759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:03.985407 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.985978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.986364 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:03.987152 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:03.987593 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:03.988014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.004728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.005431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.012874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.013374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.013786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.014481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.015080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.015656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.236039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.242418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.244780 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6c68a28f-604d-4fc7-8851-40c5b9451b3f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1559 microversion: 2.1 time: 0.244476 Aug 24 06:44:04.245522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 54/102] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:04.252012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d8e424d0-2a63-44ab-8558-23c1a37a598e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1501 microversion: 2.1 time: 0.278034 Aug 24 06:44:04.252584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 49/103] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:03 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:04.266982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.267956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.276748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.277595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.278229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.279267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.280011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.281360 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.326604 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.327114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.336440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.338586 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.339040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.339797 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.340262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.340692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.350622 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=100 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:04.573284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-92731d85-ca69-4de9-a543-458219f542ba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.310075 Aug 24 06:44:04.574775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 55/104] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:04.594354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.595002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.614880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.615632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.616236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.616977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.617437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.617863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.643774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.653960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-88df3173-045c-4f8d-9c11-f71a6957a19b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.331389 Aug 24 06:44:04.655050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 50/105] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:04.906428 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:04.907131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:04.933208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.934213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.934983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.936109 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:04.936999 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:04.937656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:04.943096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:04.954537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5a72b83a-6f4b-41df-9533-77a7b4bca1b6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.372857 Aug 24 06:44:04.967244 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 56/106] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:05.181782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.197298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.200857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:05.206106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-cadc1497-959c-4176-a58a-ff5cd98bf360 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.303439 Aug 24 06:44:05.207815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 51/107] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:04 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:44:05.676636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:05.677245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:05.686985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.690231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.690977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.694517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.695638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.697413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.904671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c01f36-c49d-4424-85b4-9f7e4c1980d2"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:05.907495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:05.926179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.927045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.928318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:05.929909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:05.931610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:05.932258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.197309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:06.208701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-61334c07-5374-490e-83ca-c444cad0eb13 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1322 microversion: 2.1 time: 0.535472 Aug 24 06:44:06.224645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 57/108] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:05 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:06.235677 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "name": "network-vif-plugged", "status": "completed", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:06.258573 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.260307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.261756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.276746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] Creating event network-vif-plugged:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:44:06.285062 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-6dfaeef3-6f11-4192-8550-c1942217e8da req-5aebcb90-497c-4f97-b0c2-c746b6458433 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058759 Aug 24 06:44:06.289814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 58/109] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:06.307434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:06.308823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.317012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.318089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.318753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.320111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.320790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.321808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.498862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:06.507757 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-52a12280-ac1b-47d7-92b8-7c64013252be tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.216419 Aug 24 06:44:06.508351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 59/110] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:06 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:06.516235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:06.516856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:06.529669 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.530201 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.530756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:06.532291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:06.532765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:06.533197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.073555 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.082708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.090050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.091463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3a4d7623-0b35-4df7-810d-4593c1105190 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.582063 Aug 24 06:44:07.092760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 60/111] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:06 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:07.098069 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eddb672-d1fa-40ab-8cae-6e148b2e01ab", "tag": "6325096c-829d-49a5-ab4d-26363e83141d"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:07.108966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.109460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.109893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.123563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] Creating event network-changed:6325096c-829d-49a5-ab4d-26363e83141d for instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab on hv-cinder-85427 Aug 24 06:44:07.127859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-ecf7a24c-4b92-4935-98ca-3dfe3406a253 req-d74ef133-4bda-48be-85e3-7c304006ca66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033522 Aug 24 06:44:07.128824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 61/112] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:07.144516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8056a504-3f1d-4fdb-ba37-702413450a96 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "POST /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.246154 Aug 24 06:44:07.146143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 52/113] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:44:05 2022] POST /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:07.232165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.232988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.241482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.241983 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.242426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.247553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.248003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.248556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.498473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.513070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9e0052b2-4854-42e1-ad62-95f668a2772d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1516 microversion: 2.1 time: 0.285402 Aug 24 06:44:07.513928 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 62/114] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:07.541403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.542616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.544328 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:07.547057 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.551047 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.551830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.552413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.553428 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.554158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.554803 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.555636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.556234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.556875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.557872 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.558439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.559494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.589110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'flavor' on Instance uuid c37ed41f-655a-4350-8028-3ffb0012a366 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:07.676738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:07.795802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-17fedd6d-3728-4125-be45-a8f8165dd5b4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366/action" status: 200 len: 32 microversion: 2.1 time: 0.258435 Aug 24 06:44:07.799443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 63/115] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:07 2022] POST /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 06:44:07.813102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:07.817478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:07.829733 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.830381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.830947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.831957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:07.832523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:07.833077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:07.866898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:07.878886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-60554f6f-2676-499f-80d5-b01c4bcef1ee tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1364 microversion: 2.1 time: 0.352181 Aug 24 06:44:07.880180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 53/116] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:08.100580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.115879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:08.116385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c6e7b3da-b0ed-446a-9ce0-82053ce70450 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.311139 Aug 24 06:44:08.116600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:08.126982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 64/117] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:07 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:08.144903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.145719 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.145946 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.146728 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.147184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.147642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.403338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.413857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.415543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:08.416655 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c722d1e0-de24-4a30-a021-24df9c2232a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.304898 Aug 24 06:44:08.418890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 54/118] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:08 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:08.900848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:08.901466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:08.908137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.908629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.909102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:08.909853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:08.910310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:08.910736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.081737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.090463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c2e741ca-94e8-4da8-84fa-73b4e1baa19c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1549 microversion: 2.1 time: 0.193516 Aug 24 06:44:09.091605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 65/119] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:08 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:09.112725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.113401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.122007 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.122547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.124163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.125342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.125866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.126293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.138367 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.139071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.148193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.148875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.149627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.150646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.151235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.151773 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.215477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4151d95a-5384-4714-9601-b3bf47d10f5a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106988 Aug 24 06:44:09.216385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 55/120] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:09.337317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.346673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ba5b9e05-3d1a-4c37-8498-74837567669e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.212611 Aug 24 06:44:09.347777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 66/121] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:09.441793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:09.442668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:09.453826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.454314 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.454748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.455518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:09.459725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:09.460287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:09.723161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.733207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.734887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:09.736799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d1ac76cc-c978-4d7b-830b-76ffb062cfb7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1406 microversion: 2.20 time: 0.299816 Aug 24 06:44:09.737882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 56/122] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:09 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:10.379583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:10.379583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:10.379583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:10.388043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.388756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.389357 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.390455 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.391671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.392291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.760511 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:10.761126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:10.761618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.776280 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.776788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.777228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.778137 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:10.778599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:10.779024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:10.801012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7ffccdcc-4e5f-4b07-9481-b36aeb29e1a7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.433251 Aug 24 06:44:10.803876 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 67/123] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:10 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:10.978924 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.988293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.990411 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:10.992498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0cf0b79f-2295-42e1-985f-f602cd8f60e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1598 microversion: 2.20 time: 0.235910 Aug 24 06:44:10.994078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 57/124] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:44:10 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1598 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:44:11.017276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:11.017787 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:11.024015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.025056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.025708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.026424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.026879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.027496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.157007 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d59ffed8-5d29-4561-a651-12e47801a687 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.138646 Aug 24 06:44:11.159886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 68/125] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 24 06:44:11 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:44:11.307172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dab5d31b-1a4a-4ca9-999c-f8b06b7660f6", "tag": "454b34ae-8fe5-46de-9bae-481f3ada5897"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:11.319227 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.320002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.320657 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.335333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] Creating event network-changed:454b34ae-8fe5-46de-9bae-481f3ada5897 for instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 on hv-cinder-85427 Aug 24 06:44:11.341415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-bc3949d5-e8d4-4dce-b81b-7e10101db756 req-40aa53f1-1789-418d-bca7-ebd2882bc17c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038089 Aug 24 06:44:11.342655 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 58/126] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:11.828431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:11.829276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:11.842709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.843375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.843964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:11.844785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:11.845500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:11.846027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:12.494886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:12.508167 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a35c96be-ded2-43cc-92a8-eb26da413799 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.683446 Aug 24 06:44:12.508883 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 69/127] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:11 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:13.021978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:13.033517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.034006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.034509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.050725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] Creating event network-changed:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:44:13.057015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-beec7aa6-69ec-46fc-b086-310fcc3ca7ae req-be7579fa-9358-4be2-ae8f-a238754b247f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041605 Aug 24 06:44:13.062162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 59/128] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:13.534630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:13.535856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:13.540333 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:13.549033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.550814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.551483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.552385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:13.553027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:13.553606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:13.752506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:13.763471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-44cea853-748a-4656-97c4-633fd74d2dfd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.231829 Aug 24 06:44:13.764802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 70/129] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:13 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:14.785734 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:14.786434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:14.792270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:14.794488 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.796584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.796584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.796584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:14.796871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:14.797130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:14.966477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:14.976982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-df22f68e-6ed7-42e5-a1d1-ec49a67d04e7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.195849 Aug 24 06:44:14.978633 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 60/130] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:14 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:16.011039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:16.013423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:16.019755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.020451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.021047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.021901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:16.022500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:16.023089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:16.211676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:16.225301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-dda5dbd6-f00a-4b36-98bd-f4154296e3e6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.218749 Aug 24 06:44:16.225903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 71/131] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:16 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:17.247738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:17.248376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:17.255906 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:17.256420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:17.256855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.257586 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:17.258075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:17.258651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:17.401821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:17.409597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-905e067b-352f-4b8a-af94-dcdbaefdb63e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.166116 Aug 24 06:44:17.410192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 61/132] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:17 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:18.431556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:18.433131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:18.439746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.440219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.440844 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.441536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:18.441980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:18.442570 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:18.593305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:18.601540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4c5b691b-704c-4e65-854f-5b24b85a90bc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.174754 Aug 24 06:44:18.602442 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 72/133] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:18 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:19.624117 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:19.624823 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:19.631807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.632347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.632804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.633651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:19.634167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:19.634842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:19.805067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:19.817521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-395beb41-e215-4f60-9309-5359ed19a134 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.197584 Aug 24 06:44:19.818104 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 62/134] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:19 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:20.840545 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:20.841299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:20.847781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.848203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.848633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:20.849499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:20.850106 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:20.850523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.041015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:21.049591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5aae6c22-48d3-4cff-9959-9382eb560793 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.214699 Aug 24 06:44:21.050165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 73/135] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:20 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:21.083151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-569728039", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "networks": [{"uuid": "8c682e0c-d2b1-404f-9302-13fb87fddf13"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:21.142486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] validate_networks() for [('8c682e0c-d2b1-404f-9302-13fb87fddf13', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:21.514190 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:21.514736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:21.515323 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:21.515982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:21.516875 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:21.535336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.536037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.536778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.538073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.538351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.538781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.550183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:21.557353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:21.569524 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.569524 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.569524 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.569935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Getting quotas for project b1d68e8e7e104bccb721e3c036a7907a. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:21.570024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.570024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.570024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.576589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Getting quotas for user 686bbf803837400e94f1df1efd04a407 and project b1d68e8e7e104bccb721e3c036a7907a. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:21.597838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:21.598306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:44:21.601273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:21.668073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e8259835-d7a2-4cb2-85c9-30e99dcfd210 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589145 Aug 24 06:44:21.669225 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 63/136] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:44:21.683149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-797aefbf-920f-4188-ae14-a211e8a648ef tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:21.684857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-797aefbf-920f-4188-ae14-a211e8a648ef tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:21.745337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-577471fc-3891-4729-a0c4-c8b59d789bfa tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 204 len: 0 microversion: 2.1 time: 0.201441 Aug 24 06:44:21.746086 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 74/137] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:44:21 2022] DELETE /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:44:21.754891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:21.755924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:21.766872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-797aefbf-920f-4188-ae14-a211e8a648ef tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:21.770963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.771719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.773646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.775835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:21.777093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:21.777859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-797aefbf-920f-4188-ae14-a211e8a648ef tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1218 microversion: 2.1 time: 0.101747 Aug 24 06:44:21.778407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:21.779918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 64/138] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:21 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:21.977192 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:21.987596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-98e002c6-8d8f-4be3-b725-24095206a8d9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1553 microversion: 2.1 time: 0.236921 Aug 24 06:44:21.988235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 75/139] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:21 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:22.071449 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:22.072197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:22.083078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.083638 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.084686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.092519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.094295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.095039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.267435 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:22.275232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-290497bb-f6c4-4cb2-9ea3-982bff979fdc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.208193 Aug 24 06:44:22.275809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 65/140] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:22 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:22.802094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:22.802817 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:22.809032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.809614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.810119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.810869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:22.811819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:22.812307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:22.874128 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:22.883238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2a1f648a-67b5-4cf8-8088-59fc110d47a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1222 microversion: 2.1 time: 0.084902 Aug 24 06:44:22.884419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 76/141] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:22 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:23.013623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:23.014321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.020901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.021569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.022122 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.022854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.023371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.023802 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.166009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:23.174573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bc143870-5e86-4cd2-b7c3-611f6323ed82 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1553 microversion: 2.1 time: 0.166818 Aug 24 06:44:23.175242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 66/142] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:23 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:23.296301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:23.296915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.303148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.303777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.304114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.304800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.305279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.305707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.448214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:23.451005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:23.458482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5104beed-411c-43d1-83a7-a18b430038f4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.166300 Aug 24 06:44:23.459039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 77/143] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:23 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:23.908610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:23.909229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:23.915665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.916087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.916626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.917318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:23.917780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:23.918206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:23.982129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:23.990548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0a13725e-9813-4922-a359-a9ac0e8f7e8e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1214 microversion: 2.1 time: 0.087106 Aug 24 06:44:23.991117 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 67/144] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:23 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:24.196910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:24.198035 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:24.205133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.205624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.206059 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.206765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.207244 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.207676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.357489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:24.365831 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-55e58984-40e2-4a04-8884-4406917f28f9 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1553 microversion: 2.1 time: 0.173486 Aug 24 06:44:24.366444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 78/145] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:24 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:24.480856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:24.481599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:24.488609 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.489249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.489724 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.490381 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:24.490827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:24.491399 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:24.716934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:24.721247 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:24.727073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b97cf269-6142-48e0-8d04-ce773c43ee11 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.250956 Aug 24 06:44:24.741230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 68/146] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:24 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:25.013761 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.014374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.023494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.024901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.025343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.026202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.026914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.027359 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.113728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:25.121660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0a3487ca-0b75-4a8c-a2c6-2cdc9529ba8f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1276 microversion: 2.1 time: 0.113281 Aug 24 06:44:25.135235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 79/147] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1276 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:25.393394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.394574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aec55df-6956-4258-81c9-469249e92ee8", "name": "network-vif-deleted", "tag": "3ac81731-4203-4914-a5b4-e0429c7bf9e1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:25.397606 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.412686 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.413234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.413688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.418526 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.419699 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.434083 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.435952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] Creating event network-vif-deleted:3ac81731-4203-4914-a5b4-e0429c7bf9e1 for instance 9aec55df-6956-4258-81c9-469249e92ee8 on hv-cinder-85427 Aug 24 06:44:25.437314 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.437819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.438264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.442641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-e9a4003a-d2d6-43f6-b672-63251deeb1b5 req-ea9efcb3-a228-444f-97af-2cd4e2fa4ac6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051367 Aug 24 06:44:25.446625 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 80/148] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:25.549681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3061468e644588a9f7f8de2af94827', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b7ab43f7824f6c8a17988db2a25807', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:25.562935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ada8e602-ee87-44b2-958f-09b185b5e31e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 200 len: 1511 microversion: 2.1 time: 0.176066 Aug 24 06:44:25.564131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 69/149] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:25.750170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:25.751047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:25.758411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.759119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.759590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:25.760910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:25.761520 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:25.761959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.068624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.080854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9f46dd32-76b6-4b09-bace-c5843464dc5f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.336677 Aug 24 06:44:26.081639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 81/150] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:25 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:26.142456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.143272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.161566 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.162746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.163400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.164846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.165318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.167480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.440541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:26.449509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b3ae1c6d-cd98-4136-bd42-a1b60f92d56d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.311193 Aug 24 06:44:26.450449 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 70/151] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:26.547338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b607344-1425-4d24-9b6f-3b78de61737b", "tag": "39027cd7-799c-4639-bf55-55e5d763c37a"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:26.570917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.571796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.573140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.587229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.599399 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.616777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] Creating event network-changed:39027cd7-799c-4639-bf55-55e5d763c37a for instance 7b607344-1425-4d24-9b6f-3b78de61737b on hv-cinder-85427 Aug 24 06:44:26.619897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.620670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.621213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.622009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.622703 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.623749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.631334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-eb65b96a-d899-44cd-b397-027b3d21dd4e req-69a34919-ce50-4fcd-8500-ee1d4c5748e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089144 Aug 24 06:44:26.633385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 82/152] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:26.643934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] HTTP exception thrown: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Request method failure captured: Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 HTTP/1.1 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciPG-s-O7NwchgDfTkapKrfRzG1dAzbM-GELLMREQWafQQ9Lb2kOfZZM8VUJVswafzeulOcLIMlpfBor-D0FFz1Ta-inroZ7t0T0EFqrDMMc2yf5i9uEHQspuSlvj3mj88dOl-lk-HYvZvBt4sSMx5Fx3ECgXKGNE7eyY4OrSudq0M Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:26.657569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59b7ab43f7824f6c8a17988db2a25807", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 7f3061468e644588a9f7f8de2af94827 Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.658868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '9aec55df-6956-4258-81c9-469249e92ee8'} Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:26.659595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.660722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.661687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Returning 404 to user: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:26.661687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0a8e38fd-bda0-4581-8977-02957e8b5051 tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 404 len: 111 microversion: 2.1 time: 0.076257 Aug 24 06:44:26.661687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 71/153] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:26.816146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:26.818691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:26.825726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.826222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.826661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.827391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:26.827847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:26.828273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:26.842707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] HTTP exception thrown: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Request method failure captured: Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8/os-volume_attachments HTTP/1.1 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciPG-s-O7NwchgDfTkapKrfRzG1dAzbM-GELLMREQWafQQ9Lb2kOfZZM8VUJVswafzeulOcLIMlpfBor-D0FFz1Ta-inroZ7t0T0EFqrDMMc2yf5i9uEHQspuSlvj3mj88dOl-lk-HYvZvBt4sSMx5Fx3ECgXKGNE7eyY4OrSudq0M Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:44:26.852405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59b7ab43f7824f6c8a17988db2a25807", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 7f3061468e644588a9f7f8de2af94827 Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.854465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'server_id': '9aec55df-6956-4258-81c9-469249e92ee8'} Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:26.855513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:26.856868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:26.858172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Returning 404 to user: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:26.858172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5a09128a-d0d7-410d-9fce-ae2cc294334e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043723 Aug 24 06:44:26.858172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 83/154] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:44:26 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:27.102313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:27.102971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:27.109683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.110243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.110923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.111697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.112251 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.112731 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.262050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.279154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3ae92d4e-cb98-45c2-8263-ce571ff02673 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.180794 Aug 24 06:44:27.280005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 72/155] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:27 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:27.475096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:27.475868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:27.483804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.484288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.484729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.485413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:27.485870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:27.486292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:27.634641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:27.643092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b11dd6cc-8473-4748-b592-35afd54f17a8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.173012 Aug 24 06:44:27.643732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 84/156] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:27 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:28.084075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.084615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.092065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.092631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.093089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.093802 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.094281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.094755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.109115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] HTTP exception thrown: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Request method failure captured: Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 HTTP/1.1 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciPG-s-O7NwchgDfTkapKrfRzG1dAzbM-GELLMREQWafQQ9Lb2kOfZZM8VUJVswafzeulOcLIMlpfBor-D0FFz1Ta-inroZ7t0T0EFqrDMMc2yf5i9uEHQspuSlvj3mj88dOl-lk-HYvZvBt4sSMx5Fx3ECgXKGNE7eyY4OrSudq0M Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:28.110545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59b7ab43f7824f6c8a17988db2a25807", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 7f3061468e644588a9f7f8de2af94827 Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.112024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '9aec55df-6956-4258-81c9-469249e92ee8'} Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:28.115886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.116965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.118101 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Returning 404 to user: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:28.118101 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ba8cce6f-bd0d-4450-82c1-9bc7d743fa3f tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 404 len: 111 microversion: 2.1 time: 0.031868 Aug 24 06:44:28.118101 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 73/157] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:44:28 2022] DELETE /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:28.124139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.124751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] [instance: 9aec55df-6956-4258-81c9-469249e92ee8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.130638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.131126 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.131614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.132305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.132759 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.133245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.146984 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] HTTP exception thrown: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Request method failure captured: Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 HTTP/1.1 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciPG-s-O7NwchgDfTkapKrfRzG1dAzbM-GELLMREQWafQQ9Lb2kOfZZM8VUJVswafzeulOcLIMlpfBor-D0FFz1Ta-inroZ7t0T0EFqrDMMc2yf5i9uEHQspuSlvj3mj88dOl-lk-HYvZvBt4sSMx5Fx3ECgXKGNE7eyY4OrSudq0M Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:44:28.149236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59b7ab43f7824f6c8a17988db2a25807", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59b7ab43f7824f6c8a17988db2a25807"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 59b7ab43f7824f6c8a17988db2a25807 Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206493735 Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 7f3061468e644588a9f7f8de2af94827 Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-DeleteServersTestJSON-1206493735-project Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.150710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '9aec55df-6956-4258-81c9-469249e92ee8'} Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:28.152048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. Aug 24 06:44:28.153613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:28.154608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] Returning 404 to user: Instance 9aec55df-6956-4258-81c9-469249e92ee8 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:28.154608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-37ac87ac-7b6f-4aca-a8b2-41423c5bb56e tempest-DeleteServersTestJSON-1206493735 tempest-DeleteServersTestJSON-1206493735-project] 10.222.0.52 "GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8" status: 404 len: 111 microversion: 2.1 time: 0.030641 Aug 24 06:44:28.154608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 85/158] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/9aec55df-6956-4258-81c9-469249e92ee8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:28.302902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.303753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.313839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.316569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.317079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.319736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.320361 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.323723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.560523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.569600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d1bb2e9d-e6b3-4c37-8ee3-7ae42db24886 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.271990 Aug 24 06:44:28.570187 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 74/159] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:28.664405 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:28.665811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:28.672274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.672982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.673589 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.674492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:28.674959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:28.675469 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:28.862360 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:28.870134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-100ff75b-efc9-450a-b343-47f44cfac1c0 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.209642 Aug 24 06:44:28.870699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 86/160] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:28 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:29.591473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:29.592771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:29.601006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.601716 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.602156 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.602892 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.603539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.604396 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.751450 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:29.759796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d80b37a2-7665-49d1-a9e2-c8a5ae1e2a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.173722 Aug 24 06:44:29.760394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 75/161] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:29 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:29.897682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:29.898905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:29.913615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.914403 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.914859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:29.915580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:29.916040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:29.916471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:30.066451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:30.075518 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f1ba1cba-b473-47ed-aded-f49c6a9da436 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.187014 Aug 24 06:44:30.077028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 87/162] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:29 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:30.783778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:30.784370 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:30.795438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:30.796109 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:30.796725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:30.797593 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:30.798777 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:30.799425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.024326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:31.043377 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fc4bd366-28ca-4d5b-837c-95049787a499 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.259364 Aug 24 06:44:31.044153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 76/163] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:30 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:31.098725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:31.099346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:31.109864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.110685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.111210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.112457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:31.112798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:31.113214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:31.343479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:31.357547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2e762747-b426-4ce2-b7b4-1101387f613b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.262813 Aug 24 06:44:31.372696 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 88/164] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:31 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:32.066335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:32.068404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:32.073748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:32.074814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=8 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:32.077391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.078242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.078950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.079957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.080604 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.081268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.280352 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.292376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-311ae4da-c8fb-4ed5-9c3e-1fce2e29238f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.229866 Aug 24 06:44:32.295084 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 77/165] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:32 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:32.381860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:32.382631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:32.389687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.390173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.393548 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.394282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.394740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.397372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.666385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:32.685415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-167cd782-9890-4af5-9ff0-75027cb01a8b tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.307331 Aug 24 06:44:32.700046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 89/166] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:32 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:32.838011 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b607344-1425-4d24-9b6f-3b78de61737b", "name": "network-vif-plugged", "status": "completed", "tag": "39027cd7-799c-4639-bf55-55e5d763c37a"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:32.851855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:32.852527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:32.853094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:32.867408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] Creating event network-vif-plugged:39027cd7-799c-4639-bf55-55e5d763c37a for instance 7b607344-1425-4d24-9b6f-3b78de61737b on hv-cinder-85427 Aug 24 06:44:32.874992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-5d8005a6-3fdd-4f78-80ed-dac3f1de044c req-9dfa53bf-7a15-4f20-9cf0-3ec8888a5dc1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040863 Aug 24 06:44:32.876517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 78/167] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:33.315249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.315805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:33.321789 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.322283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.322761 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.323503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.323972 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.324399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.467320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.477419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9e5a035a-cd1a-494f-8ff2-503400331557 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.166541 Aug 24 06:44:33.478141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 90/168] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:33.712633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.713251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:33.719847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.720332 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.720760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.721452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:33.721899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:33.722312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:33.751747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c5268ad2-bfcf-4f6a-a26e-26263c680798 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Action: 'create', calling method: .version_select at 0x7f3dc89bf940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1692625541", "metadata": {"Type": "work"}}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c5268ad2-bfcf-4f6a-a26e-26263c680798 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 122 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.768205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1692625541", "metadata": {"Type": "work"}}} Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.769696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1692625541', 'metadata': {'Type': 'work'}}}} Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.770462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:44:33.771675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:44:33.772867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:44:33.772867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.773363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c5268ad2-bfcf-4f6a-a26e-26263c680798 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.774278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c5268ad2-bfcf-4f6a-a26e-26263c680798 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149821 Aug 24 06:44:33.775252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 79/169] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:44:33.785542 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5d24a0a3-429e-4d73-891b-1738b3535c49 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Action: 'create', calling method: .version_select at 0x7f3dc8857310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-979227556", "metadata": {"Type": "work"}}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5d24a0a3-429e-4d73-891b-1738b3535c49 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 119 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.791904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-979227556", "metadata": {"Type": "work"}}} Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.793072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-979227556', 'metadata': {'Type': 'work'}}}} Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi '0' Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.793771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:44:33.794960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:44:33.796062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:44:33.796062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.796062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5d24a0a3-429e-4d73-891b-1738b3535c49 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.796062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5d24a0a3-429e-4d73-891b-1738b3535c49 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010567 Aug 24 06:44:33.796062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 80/170] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:44:33.809029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9a461e0d-14e2-4d8b-aafd-b80f1d739190 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Action: 'create', calling method: .version_select at 0x7f3dc8962700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-977839277", "metadata": {"Type": "work"}}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9a461e0d-14e2-4d8b-aafd-b80f1d739190 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 118 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.812995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-977839277", "metadata": {"Type": "work"}}} Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.814451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-977839277', 'metadata': {'Type': 'work'}}}} Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi '' Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.815317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:44:33.817116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:44:33.818124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:44:33.818124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.818124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9a461e0d-14e2-4d8b-aafd-b80f1d739190 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.818124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9a461e0d-14e2-4d8b-aafd-b80f1d739190 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009754 Aug 24 06:44:33.819145 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 81/171] 10.222.0.52 () {60 vars in 1156 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:44:33.824168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-94132804-45fd-433c-b33c-570022847e5d tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Calling method '.version_select at 0x7f3dc8a82e50>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.867765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-94132804-45fd-433c-b33c-570022847e5d tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] HTTP exception thrown: Volume tempest-invalid-1279249605 could not be found. Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-94132804-45fd-433c-b33c-570022847e5d tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1279249605 HTTP/1.1 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.869922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Volume tempest-invalid-1279249605 could not be found. Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'tempest-invalid-1279249605'} Aug 24 06:44:33.871519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1279249605 could not be found. (HTTP 404) (Request-ID: req-4cb37337-2db1-4ed5-8afd-18bbbf66da3a) Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.872369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:44:33.873563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1279249605 could not be found. Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:33.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1279249605 could not be found. Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1279249605 could not be found. Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-94132804-45fd-433c-b33c-570022847e5d tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 404 to user: Volume tempest-invalid-1279249605 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-94132804-45fd-433c-b33c-570022847e5d tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1279249605" status: 404 len: 99 microversion: 2.1 time: 0.051127 Aug 24 06:44:33.876369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 82/172] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 06:44:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1279249605 => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 06:44:33.880966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c96c01c7-4f11-4d54-a13a-8cfeb505b256 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003913 Aug 24 06:44:33.881470 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 83/173] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 24 06:44:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 24 06:44:33.890990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b41548fe-6cf4-45a6-b933-c77c35b10c76 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003667 Aug 24 06:44:33.891633 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 84/174] 10.222.0.52 () {58 vars in 1137 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 06:44:33.895604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:33.900582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-32fa23f9-a09c-4be2-8c48-01de39e15bc4 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Calling method '.version_select at 0x7f3dc893caf0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.903690 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-40c3887d-9b7d-4e09-afb9-ffdbd8e76a1e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.195073 Aug 24 06:44:33.904274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 91/175] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:33.929728 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-32fa23f9-a09c-4be2-8c48-01de39e15bc4 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] HTTP exception thrown: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-32fa23f9-a09c-4be2-8c48-01de39e15bc4 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/os-volumes/7cf4b5b1-9ff4-496c-9386-497ffbd77794 HTTP/1.1 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.931800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '7cf4b5b1-9ff4-496c-9386-497ffbd77794'} Aug 24 06:44:33.933343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. (HTTP 404) (Request-ID: req-ba35bd45-4493-46fa-9470-b19c1c439251) Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.934219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:44:33.935675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:44:33.937626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.939677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-32fa23f9-a09c-4be2-8c48-01de39e15bc4 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 404 to user: Volume 7cf4b5b1-9ff4-496c-9386-497ffbd77794 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.940488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1999937473", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "networks": [{"uuid": "39af791a-b387-443a-ae21-b2e1fb790901"}]}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:33.940589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-32fa23f9-a09c-4be2-8c48-01de39e15bc4 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/7cf4b5b1-9ff4-496c-9386-497ffbd77794" status: 404 len: 109 microversion: 2.1 time: 0.036762 Aug 24 06:44:33.940589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 85/176] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:44:33 2022] DELETE /compute/v2.1/os-volumes/7cf4b5b1-9ff4-496c-9386-497ffbd77794 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:33.948622 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6acf68e2-f569-4455-b6a6-bc76a4636954 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Calling method '.version_select at 0x7f3dc89628b0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:33.978973 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6acf68e2-f569-4455-b6a6-bc76a4636954 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] HTTP exception thrown: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6acf68e2-f569-4455-b6a6-bc76a4636954 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Request method failure captured: Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/os-volumes/d23c789d-d67c-43e7-b2d4-99b5b9451ce2 HTTP/1.1 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjRGO2A8G8bzOAae3lpO5sN-ZXFZ8JGM4gORMOLx3DLzMgxwNJIP1cj3vpqtZISFSWvw5bJI8W0ILHakw4RUS_NXr0-UdrBwPqupjbRG2ab_zwFsz6kufp3ZYBlhUGU0hr4VOT8wRlas-6SZHA5zwSFNmeY00oRKY6NTeNf69n3wr4 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:44:33.981103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_641b0738db51447b9b816b90900128da", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/641b0738db51447b9b816b90900128da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/641b0738db51447b9b816b90900128da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 641b0738db51447b9b816b90900128da Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesNegativeTest-2073865286 Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 00c763381c064af4b52623b0674771ad Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesNegativeTest-2073865286-project Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'd23c789d-d67c-43e7-b2d4-99b5b9451ce2'} Aug 24 06:44:33.982447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. (HTTP 404) (Request-ID: req-95b7f964-d0f8-40a9-a3b6-87e0104785ff) Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.983474 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:44:33.984695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:44:33.985879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6acf68e2-f569-4455-b6a6-bc76a4636954 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] Returning 404 to user: Volume d23c789d-d67c-43e7-b2d4-99b5b9451ce2 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6acf68e2-f569-4455-b6a6-bc76a4636954 tempest-VolumesNegativeTest-2073865286 tempest-VolumesNegativeTest-2073865286-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d23c789d-d67c-43e7-b2d4-99b5b9451ce2" status: 404 len: 109 microversion: 2.1 time: 0.038435 Aug 24 06:44:33.987768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 86/177] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:44:33 2022] GET /compute/v2.1/os-volumes/d23c789d-d67c-43e7-b2d4-99b5b9451ce2 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:44:33.990854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] validate_networks() for [('39af791a-b387-443a-ae21-b2e1fb790901', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:34.358213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:34.358667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:34.359140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:34.359576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:34.359992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:34.373058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.373541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.373972 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.374751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.375235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.375654 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.392514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Getting quotas for project 0930b613a69749d3bc05240e88f74ccc. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:34.396445 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Getting quotas for user 814c0227c728493ebd4364bc154cee83 and project 0930b613a69749d3bc05240e88f74ccc. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:34.407451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:34.409749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:34.459772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4ed214a1-7f7c-48d9-9549-2eb98e5cde27 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530863 Aug 24 06:44:34.460497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 92/178] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:44:34.472061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-50d817b9-e93c-4619-809f-c9e84a19b18d tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.473244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-50d817b9-e93c-4619-809f-c9e84a19b18d tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.508550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.509355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.539046 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-50d817b9-e93c-4619-809f-c9e84a19b18d tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.540043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.540743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.541197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.548688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.549199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.549645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.553319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-50d817b9-e93c-4619-809f-c9e84a19b18d tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1214 microversion: 2.1 time: 0.085640 Aug 24 06:44:34.553895 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 87/179] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:34.689877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:34.698296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-10913744-f0c0-4008-9a0f-641b12de9ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.196074 Aug 24 06:44:34.699279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 93/180] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:34.925375 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:34.925988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:34.933328 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.933813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.934307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:34.934978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:34.935473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:34.935893 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.084040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.094446 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-63ab977a-755d-429e-a54d-319d92dee4f8 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1318 microversion: 2.1 time: 0.173093 Aug 24 06:44:35.095006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 88/181] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:34 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:44:35.574280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.574887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.581132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.581594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.582063 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.582762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.583235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.583675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.653287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.663851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f7dd24de-3502-42f0-b222-a4e88a39307e tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1266 microversion: 2.1 time: 0.093614 Aug 24 06:44:35.664356 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 94/182] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:35.720994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:35.721615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:35.727864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.728351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.728824 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.730030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:35.730485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:35.730976 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:35.880410 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:35.890539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2909b9be-b5aa-404e-b0ae-dd989f7da446 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.174867 Aug 24 06:44:35.891342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 89/183] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:35 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:36.117288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.118154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.125274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.125756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.126619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.127365 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.127818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.128243 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.583972 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:36.600116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-abb71128-4b61-4308-b55c-6820b590a0f6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1507 microversion: 2.1 time: 0.488023 Aug 24 06:44:36.604453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 95/184] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:36.688019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.688629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.695847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.696521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.696950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.697997 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.699038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.699843 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.781843 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:36.792404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-62de31e0-05d0-42f6-8364-8d5d967ee7a8 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1272 microversion: 2.1 time: 0.108985 Aug 24 06:44:36.793043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 90/185] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1272 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:36.912062 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:36.913093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:36.919995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.920847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.921496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:36.922395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:36.923120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:36.923847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.161683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:37.170073 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a77519df-a304-4471-8693-2d7bb8fe492e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.262185 Aug 24 06:44:37.170767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 96/186] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:36 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:37.810348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1deca0b7-1c1c-4381-973e-7dd1d8b98359", "tag": "a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:37.819695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:37.820337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:37.821355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.822082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.822779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.836818 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] Creating event network-changed:a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550 for instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 on hv-cinder-85427 Aug 24 06:44:37.840175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.840814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.841242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.841959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:37.851328 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:37.852084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:37.860376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-e9797560-ec5e-48cf-be62-d5f10e521ec9 req-c7ab8840-575c-433b-ada1-3b0ee8e1e965 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051415 Aug 24 06:44:37.862969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 91/187] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:38.139648 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.142914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:38.150288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2e2bdd8e-fb7d-4632-9660-b8005e3fbf11 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.337166 Aug 24 06:44:38.151292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 97/188] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:37 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:38.194304 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:38.195432 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:38.202238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.202726 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.203157 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.203891 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:38.204366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:38.204740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:38.419964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:38.430669 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-96de75af-98ed-4d4c-a451-1a74569ef940 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.241827 Aug 24 06:44:38.431255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 92/189] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:38 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:39.172324 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.173034 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.179534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.180017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.180475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.181555 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.182009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.182431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.327331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.335498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-adc2902b-abe7-4a10-b78f-9aaac86ad307 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.167834 Aug 24 06:44:39.336260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 98/190] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:39.453157 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:39.453924 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:39.460940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.461832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.462519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.463335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:39.463864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:39.464384 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:39.602714 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:39.610677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e8607229-0c2e-47e3-8344-ea25121eef64 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.162057 Aug 24 06:44:39.611277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 93/191] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:39 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:40.357649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:40.358277 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:40.364683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.365171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.365613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.366381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.367444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.367913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.505478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.513450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5e24d2cf-22ee-4fe3-8d03-3c84821c5a94 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.159790 Aug 24 06:44:40.514036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 99/192] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:40 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:40.635026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:40.635634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:40.645584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.646183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.646760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.647858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:40.648481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:40.649031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:40.796978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:40.804685 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3238514f-3fa8-4320-bc8e-88ec2e98a012 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.175622 Aug 24 06:44:40.805223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 94/193] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:40 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:41.542727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:41.543640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:41.553478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.554199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.554808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.555838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.556413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.557056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.696190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:41.704655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-41368243-5c0e-446c-8119-d932752a2377 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.168092 Aug 24 06:44:41.705200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 100/194] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:41 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:41.827854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:41.828434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:41.836518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.837042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.837500 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.838212 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:41.838664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:41.839283 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:41.977986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:41.986219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e7fd4022-a73a-4c1b-a240-bf86bec956c0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.163424 Aug 24 06:44:41.986795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 95/195] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:41 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:42.727226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:42.727827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:42.734579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.735073 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.735546 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.736243 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:42.736701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:42.737132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:42.875931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:42.884100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-059841fa-8ab1-4834-976e-fe7d0613b574 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.160957 Aug 24 06:44:42.884682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 101/196] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:42 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:43.006148 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.006777 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.014121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.014936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.015026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.015764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.016224 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.016653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.230256 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:43.239439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-083c75c1-41ba-48d6-846a-c7d918095622 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.237175 Aug 24 06:44:43.240016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 96/197] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:43.906359 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:43.907617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:43.910725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:43.914283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.914774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.915335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:43.915917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:43.916371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:43.916820 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.063590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.071718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-eb43695b-ecdc-414d-aa80-4437bc6f333a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.170178 Aug 24 06:44:44.072349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 102/198] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:43 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:44.262143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:44.263947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:44.269798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.270286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.270748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.271489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.271948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.272376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.276741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=100 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.412346 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:44.420359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2f2ad884-3a36-41b8-b134-23266ca9f944 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.162407 Aug 24 06:44:44.420938 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 97/199] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:44 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:44.625767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deca0b7-1c1c-4381-973e-7dd1d8b98359", "name": "network-vif-plugged", "status": "completed", "tag": "a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:44.632453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.633189 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:44.640071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:44.640712 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:44.641152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:44.655121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] Creating event network-vif-plugged:a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550 for instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 on hv-cinder-85427 Aug 24 06:44:44.660794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-339724a7-e4ab-4f27-9362-22e391636235 req-e8cb854b-98c9-4ca0-94fc-472f69d6334c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Aug 24 06:44:44.661553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 103/200] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:45.097170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:45.097897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:45.100551 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:45.101442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:45.110690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.111358 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.112022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.113086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.113784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.114454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.251786 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.259644 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4117000d-f501-4a6b-99e0-db7df21fc697 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.169400 Aug 24 06:44:45.260232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 98/201] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:45 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:45.447931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:45.448758 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:45.454940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.455449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.456088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.456777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:45.457225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:45.457638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:45.597837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:45.605926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8478625a-5e38-4d36-98be-12e0cd471707 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.163587 Aug 24 06:44:45.606523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 104/202] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:45 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:46.282312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:46.282932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:46.292742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.293229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.293670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.294365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.294830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.295276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.436923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.447032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-cc8f70ad-99d7-4146-8547-fab8f4313805 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1314 microversion: 2.1 time: 0.170899 Aug 24 06:44:46.447737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 99/203] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:46 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:46.625837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:46.626449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:46.633026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.633656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.634096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.634803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:46.635288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:46.635877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:46.771400 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:46.779616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-451d4f3c-80d6-473c-8ce1-07d094fed964 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.157597 Aug 24 06:44:46.780180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 105/204] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:46 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:47.468875 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:47.469505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:47.476827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.477315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.477786 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.478455 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.478943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.479434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.616629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:47.624667 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e9f6784a-6059-46c8-a760-0b7506cd844f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1498 microversion: 2.1 time: 0.160251 Aug 24 06:44:47.625220 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 100/205] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:47 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:47.803670 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:47.804266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:47.810745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.811286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.812092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.812772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:47.813341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:47.813844 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:47.963297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:47.971908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-553f9062-39d3-4cd7-8996-a83320be1579 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.173605 Aug 24 06:44:47.972418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 106/206] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:47 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:48.134120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.134621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:48.141412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.145347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.145798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.146518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.146980 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.147436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.173128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:44:48.272479 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f0a199f7-4505-44e7-a957-db7c54c040a5 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 204 len: 0 microversion: 2.1 time: 0.142072 Aug 24 06:44:48.273120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 101/207] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:44:48 2022] DELETE /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:44:48.282001 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.282609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:48.288531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.289004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.289621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.290297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:48.290781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:48.291180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:48.423156 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:48.431453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cae32d34-c846-49b5-94af-ac66ab4004c3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1504 microversion: 2.1 time: 0.153453 Aug 24 06:44:48.432004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 107/208] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:48 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:48.995413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:48.996093 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:49.003586 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.004076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.004519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.005223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.005678 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.006108 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.167112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.174937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-eab341a5-d64e-4584-b763-02c9559feded tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.185380 Aug 24 06:44:49.175579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 102/209] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:48 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:49.454760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:49.455409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:49.461863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.462354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.462791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.463523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:49.464012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:49.464444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:49.607672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:49.615753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3003613e-6d27-4d9b-a7cc-21e26d3403bf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1504 microversion: 2.1 time: 0.166435 Aug 24 06:44:49.616335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 108/210] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:49 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:50.196622 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:50.197258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:50.204576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.205061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.205501 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.206193 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.206679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.207138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.347107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.355461 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-12bfcbc0-74e0-4109-aa51-5d8435508163 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.162705 Aug 24 06:44:50.356042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 103/211] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:50 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:50.637084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:50.637682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:50.643731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.644228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.644665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.645369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:50.645827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:50.646254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:50.793924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:50.804011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cff41d0c-f4c7-4255-b335-d7f3cf26c1dc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1504 microversion: 2.1 time: 0.170825 Aug 24 06:44:50.804625 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 109/212] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:50 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:51.381469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:51.382014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:51.390560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.391049 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.391504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.392201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.392653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.393050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.639509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.647986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c0d2ace2-5ec9-437b-9293-73f7d6509c70 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.270491 Aug 24 06:44:51.648570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 104/213] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:51 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:51.829821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:51.830448 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:51.837648 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.838145 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.838709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.839601 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.840227 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.840804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.946295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:51.955981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-19ca7568-1766-4afb-b14a-832333d288bd tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1462 microversion: 2.1 time: 0.131382 Aug 24 06:44:51.956559 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 110/214] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:51 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1462 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:51.965442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1deca0b7-1c1c-4381-973e-7dd1d8b98359", "name": "network-vif-deleted", "tag": "a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:51.975082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:51.975598 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:51.976019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:51.987506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] Creating event network-vif-deleted:a7c09b6c-ea8e-4b5c-a3dc-e817b7ace550 for instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 on hv-cinder-85427 Aug 24 06:44:51.992394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-7241300e-b0e2-4dbd-a7ac-7e5fc44cba3e req-fd627eca-43c5-4e39-a5b2-45d6442d445e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 Aug 24 06:44:51.993277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 105/215] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:44:52.672850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:52.673691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:52.682781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.683301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.683737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.684422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.684873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.685320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.828913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:52.836874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1943af16-fe98-4e48-ba75-33cb31baca91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1522 microversion: 2.1 time: 0.170324 Aug 24 06:44:52.837481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 111/216] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:52 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:52.979917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:52.980854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:52.989387 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.990051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.990995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:52.992051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:52.992690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:52.993331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.032596 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.033905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.034541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.035022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lazy-loading 'fault' on Instance uuid 1deca0b7-1c1c-4381-973e-7dd1d8b98359 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:53.082003 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:53.091480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4aee3dac-7eff-48a6-bdb3-5d52616fd0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 200 len: 1304 microversion: 2.1 time: 0.116696 Aug 24 06:44:53.092081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 106/217] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:52 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:53.862266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:53.863141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:53.870275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.870792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.871280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:53.872169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:53.872639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:53.873068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.022098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.030762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-830f04ce-0a34-47c0-b05c-7e7120a53706 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1502 microversion: 2.1 time: 0.176057 Aug 24 06:44:54.031464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 112/218] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:53 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:54.052645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.053286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.060085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.060555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.060984 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.062025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.062481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.062899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.112764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.113428 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: 1deca0b7-1c1c-4381-973e-7dd1d8b98359] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.119556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.120050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.120467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.121386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.121885 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.122299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.137466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] HTTP exception thrown: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Request method failure captured: Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 HTTP/1.1 Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcjQEHwF1l3F-DZE9Rzc6MtnZ292GvbTgxiQ45bH9IJWPddPLGfRDOT3snogUlR8hCh5YPddf6V1Ehfn0FMxLoLfn_0iSJFoCtenRJNx-KeFhqSzIs1AL1VuWFQtc81sqK-zlvHPJq0PsNQ6tpxbJmGKbSsK_QlkGq8_CkylDE6EKKY Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0930b613a69749d3bc05240e88f74ccc Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesActionsTest-2076595470 Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:44:54.139143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0930b613a69749d3bc05240e88f74ccc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesActionsTest-2076595470 Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0930b613a69749d3bc05240e88f74ccc Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesActionsTest-2076595470 Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesActionsTest-2076595470-project Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 814c0227c728493ebd4364bc154cee83 Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesActionsTest-2076595470-project Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. Aug 24 06:44:54.140754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '1deca0b7-1c1c-4381-973e-7dd1d8b98359'} Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:44:54.141668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. Aug 24 06:44:54.143092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:44:54.144459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Returning 404 to user: Instance 1deca0b7-1c1c-4381-973e-7dd1d8b98359 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:44:54.144459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-910017e6-7fc7-4fed-b9d5-071fe21e9eb9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359" status: 404 len: 111 microversion: 2.1 time: 0.031912 Aug 24 06:44:54.144459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 113/219] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:54 2022] GET /compute/v2.1/servers/1deca0b7-1c1c-4381-973e-7dd1d8b98359 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:44:54.313738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-609356965", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "networks": [{"uuid": "39af791a-b387-443a-ae21-b2e1fb790901"}]}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:54.374581 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] validate_networks() for [('39af791a-b387-443a-ae21-b2e1fb790901', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:44:54.471355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.484332 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4c251ebd-0b48-4861-b291-5b3efd156c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1516 microversion: 2.1 time: 0.435299 Aug 24 06:44:54.485092 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 107/220] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:54 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:54.786846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:44:54.787381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:44:54.787936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:44:54.788415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:44:54.788828 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:44:54.801316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.802130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.804249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.805413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:54.806298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:54.807770 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:54.837408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Getting quotas for project 0930b613a69749d3bc05240e88f74ccc. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:44:54.842161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Getting quotas for user 814c0227c728493ebd4364bc154cee83 and project 0930b613a69749d3bc05240e88f74ccc. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:44:54.854858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:44:54.857839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:44:54.913785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-efaf70f5-5e30-4f6b-b7a1-19f11ac9c6ee tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604259 Aug 24 06:44:54.914981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 114/221] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:44:54.929953 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c287a9f2-b3b2-4c85-8f3c-f37de419ea18 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:54.930561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c287a9f2-b3b2-4c85-8f3c-f37de419ea18 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:54.986458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c287a9f2-b3b2-4c85-8f3c-f37de419ea18 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:54.993634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c287a9f2-b3b2-4c85-8f3c-f37de419ea18 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1213 microversion: 2.1 time: 0.068022 Aug 24 06:44:54.994202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 108/222] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:54 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:55.977595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:55.982121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:55.992118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.992906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.993607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:55.994741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:55.995712 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:55.997397 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.016457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:56.017882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:56.026863 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.029312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.031365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.032807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.033872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.035944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.036667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'flavor' on Instance uuid 8c8a1bf0-8a43-4089-b507-6dba65b29948 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:44:56.091812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:44:56.135901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.149066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1840026f-6bf7-4fa2-8cbe-79cc6192f96b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1273 microversion: 2.1 time: 0.137301 Aug 24 06:44:56.150153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 109/223] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:56 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:56.189451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c93fc455-a561-4f22-8311-04b1556f405b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/action" status: 200 len: 32 microversion: 2.1 time: 0.218065 Aug 24 06:44:56.190491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 115/224] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:44:55 2022] POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:44:56.201428 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:56.202556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:56.209138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.209867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.214721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.216490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:56.217130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:56.217715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:56.475139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:56.482782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-39fda2e2-f93b-468a-be9f-855071abea5a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.286252 Aug 24 06:44:56.483099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 110/225] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:56 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:57.172672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:57.173406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:57.182130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.182619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.183107 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.183964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.184422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.184895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.452043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.467846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1637a402-8520-40c1-86dc-987a94ea2b92 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.300076 Aug 24 06:44:57.468476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 116/226] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:57 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:57.503334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:57.504045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:57.511502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.512444 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.513144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.514260 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.514750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.515176 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.750709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8700da6-0186-42ab-98ec-9c188518ea87", "tag": "b69c453d-3284-4bf2-bb2d-015b6bca278f"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:44:57.772323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:57.773074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:57.773661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:57.790004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] Creating event network-changed:b69c453d-3284-4bf2-bb2d-015b6bca278f for instance c8700da6-0186-42ab-98ec-9c188518ea87 on hv-cinder-85427 Aug 24 06:44:57.796855 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-bccfe8fb-e98f-479f-8e87-1cf589755639 req-bee377c6-3804-4062-afbd-f96949449ba8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048931 Aug 24 06:44:57.797836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 117/227] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:44:57.857376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:57.872741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bb8c6001-e2c3-4ede-b855-ac200147ee4d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.372607 Aug 24 06:44:57.874470 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 111/228] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:57 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:58.499967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:58.500896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:58.517571 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.518395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.520000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:58.520917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.521693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.522127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:58.693881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:58.705588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7fe53715-e1a2-4e53-917f-8a05f21758a9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.219640 Aug 24 06:44:58.706637 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 118/229] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:58 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:58.895118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:58.896767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:58.904087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.904847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.905467 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:58.906187 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:58.906643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:58.907059 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:59.053239 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:59.061645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c7e3dc52-43e0-4711-9df9-60508098f731 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.170732 Aug 24 06:44:59.062510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 112/230] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:58 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:44:59.729780 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:44:59.730531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:44:59.739575 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:59.740466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:59.741757 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:59.747839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:44:59.748618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:44:59.749264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:44:59.925783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:44:59.935439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bd660427-c2eb-42c3-aedb-501245389f52 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.210997 Aug 24 06:44:59.936802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 119/231] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:44:59 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:00.085154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:00.086421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:00.093946 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.094659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.095277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:00.096132 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.096734 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.097306 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:00.116697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:00.236317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:00.245962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d9fdac2c-e436-4d02-b7a0-1482b762e52f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.164503 Aug 24 06:45:00.246533 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 113/232] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:00 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:00.958017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:00.958627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:00.968059 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.968948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.969591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:00.970543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:00.971227 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:00.971866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:01.126212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:01.145276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-652c3cdc-cb01-4c0f-b174-ff7dc73b42c7 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.179794 Aug 24 06:45:01.147144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 120/233] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:00 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:01.267087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:01.269229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:01.278372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:01.278982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:01.280057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:01.281256 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:01.281858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:01.282295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:01.461021 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:01.469775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5f1becd0-ba79-4f78-8d8a-67f99b73c8eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.206503 Aug 24 06:45:01.470353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 114/234] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:01 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:02.166516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:02.167132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:02.174915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.175446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.175881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.176586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.177036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.177676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.396302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:02.406485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6fe0d0af-8ae8-4bb8-bd6a-3bf477ad9f1a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.243820 Aug 24 06:45:02.407139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 121/235] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:02 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:02.491781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:02.492420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:02.501358 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.502099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.502880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.503859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:02.504527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:02.505159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:02.669355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:02.683607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9923c817-8555-42ae-a1ef-fc28cb754ea9 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.195984 Aug 24 06:45:02.684405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 115/236] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:02 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:03.429982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:03.430668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:03.461281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.461830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.462795 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:03.463766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.464380 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.465390 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:03.708470 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:03.711052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:03.712806 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:03.719868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-801d1490-1ae9-4294-bf1c-f8117ceb6b0a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.295487 Aug 24 06:45:03.722110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 122/237] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:03 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:03.729163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.729904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.731978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:03.732770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:03.733244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:03.738540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:03.924133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:03.932842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b1123e21-3ac4-4a3b-9dfa-fdd3897bd193 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.227164 Aug 24 06:45:03.933616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 116/238] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:03 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:04.743921 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:04.745370 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:04.753291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:04.754540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:04.755334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:04.757087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:04.757809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:04.758349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:04.824132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:04.849887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:04.954193 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:04.955771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:04.965424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:04.977180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:04.977899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:04.978811 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:04.988062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:04.988806 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:04.993601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:05.038809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:05.053221 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3d7658ff-434c-4522-9456-69a4c82d5a4a tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.313765 Aug 24 06:45:05.054371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 123/239] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:04 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:05.236032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:05.250135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1621d502-fb1c-49dc-aefb-3d5bae4fea85 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.299802 Aug 24 06:45:05.268043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 117/240] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:04 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:06.073824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:06.075043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:06.081957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.086382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.087006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.087943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.088564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.091314 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.274901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:06.277140 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:06.296850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.298558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.299251 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.301820 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:06.302467 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:06.305270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:06.341796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:06.352870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-29459cb0-d3ed-4e74-a3c3-47eb347a6464 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.280604 Aug 24 06:45:06.367784 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 124/241] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:06 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:06.752401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:06.766679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fc709793-490a-4f45-b855-882d7d0ce72e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.497257 Aug 24 06:45:06.767296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 118/242] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:06 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:07.083651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd4df78d-f27e-4e21-8cb7-bd78cf4b24ad", "device": "/dev/sdb"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:07.087144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:07.095138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.095959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.096552 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.097268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.097728 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.098153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.104552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2d0a9a38-ff48-4c95-b501-d8fe8e98d457 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Action: 'create', calling method: .version_select at 0x7f3dcaf138b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-961081060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrUsx12BKxIO0kDeI2tvUafWG3qycEKiSu9dcWfWeoq+EYb60Y2Uks1rv2mLI9i8t4sEmnud0Azi1smaq0TwvIjFjzCDw0cbUdCM1GzgAZiEEMgGlJXdJNPJ3vtDvBYfw=="}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:07.121882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-2d0a9a38-ff48-4c95-b501-d8fe8e98d457 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Getting quotas for project 0bf38c354bea44f5a503e76fa53b20f6. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:45:07.127548 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-2d0a9a38-ff48-4c95-b501-d8fe8e98d457 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Getting quotas for user 7957b80bf6e843d4a7a0b11f13a80db8 and project 0bf38c354bea44f5a503e76fa53b20f6. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:45:07.165825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2d0a9a38-ff48-4c95-b501-d8fe8e98d457 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.298185 Aug 24 06:45:07.166523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 125/243] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:45:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:45:07.376636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:07.377913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:07.393665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.394610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.394977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.395719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.396764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.397338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.532266 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8cda6b19-5463-4145-990d-cc638ca9f39e tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "POST /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452111 Aug 24 06:45:07.541548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 119/244] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:45:07 2022] POST /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:07.737325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:07.750991 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-18e0b199-aafa-4c5f-84c1-8bc179a13efc tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.380348 Aug 24 06:45:07.753336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 126/245] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:07 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:07.804801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:07.805514 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:07.820229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.820726 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.823684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:07.824930 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:07.825409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:07.825842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:08.157376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:08.172221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-106f778d-3811-492e-9b15-13583a3f8c56 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.380545 Aug 24 06:45:08.175549 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:07 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:08.777327 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:08.779106 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:08.788377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:08.789317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:08.794188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:08.794188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:08.794188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:08.794188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:08.977627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:08.985997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3cb18d63-649a-4aa1-824c-1c3d18d74766 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.213073 Aug 24 06:45:08.986700 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 127/247] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:08 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:09.202627 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:09.203555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:09.211817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:09.212306 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:09.212742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:09.213439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:09.213885 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:09.214362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:09.376817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:09.385222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b892e63d-10a9-4931-aaaa-6cc88c77efa0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.187458 Aug 24 06:45:09.385797 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 121/248] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:09 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:09.936775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8700da6-0186-42ab-98ec-9c188518ea87", "name": "network-vif-plugged", "status": "completed", "tag": "b69c453d-3284-4bf2-bb2d-015b6bca278f"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:09.951579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:09.952108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:09.952692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:09.967717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] Creating event network-vif-plugged:b69c453d-3284-4bf2-bb2d-015b6bca278f for instance c8700da6-0186-42ab-98ec-9c188518ea87 on hv-cinder-85427 Aug 24 06:45:09.974155 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-e34a2d6d-200e-47cb-9f09-ead89ad5a073 req-2a2da6b8-fda9-4c2f-83c0-bf7ecf68f9ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043004 Aug 24 06:45:09.975385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 128/249] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:10.016350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:10.017664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:10.030296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:10.031813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:10.032609 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:10.033535 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:10.034012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:10.034589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:10.228475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:10.236710 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8218a518-2dde-48ca-a9a6-a99991c3b0b9 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.228001 Aug 24 06:45:10.237333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 122/250] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:10 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:10.407352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:10.408054 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:10.414683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:10.415168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:10.415710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:10.416411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:10.416858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:10.417284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:10.552883 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:10.562351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e37c57d9-1db8-4e41-bbb6-349d480df09b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.159363 Aug 24 06:45:10.564786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 129/251] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:10 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:11.257821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:11.258730 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:11.267981 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.270015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.270888 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.271654 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.272186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.272531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.430313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:11.439868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-36117ccd-0221-4f71-8271-39c64aa67a2b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.185707 Aug 24 06:45:11.441909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 123/252] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:11 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:11.582914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:11.583635 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:11.598381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.599023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.599541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.600292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:11.600746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:11.601195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:11.770951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:11.779259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d3729f63-28a6-4d50-a7ce-3d70674ea7e3 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.200168 Aug 24 06:45:11.779833 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 130/253] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:11 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:12.462480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:12.463120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:12.470512 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.471027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.471684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.472439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.473202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.473307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.615867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:12.624189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2f1156b1-048a-4ed1-a3dd-55de810b5fa3 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1313 microversion: 2.1 time: 0.165835 Aug 24 06:45:12.624770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 124/254] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:12 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:12.800112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:12.800711 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:12.807293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.807785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.808343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.809141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:12.809610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:12.810045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:12.944049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:12.952532 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-37f0b404-11fe-48b3-9554-09c53c972ca6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.156362 Aug 24 06:45:12.953119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 131/255] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:12 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:13.437329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:13.437854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:13.444382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.444873 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.445299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.445990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.446446 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.446872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.471078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f0393dc5-7dd2-4086-bba6-b63bdef739ac tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/ips" status: 200 len: 151 microversion: 2.1 time: 0.037990 Aug 24 06:45:13.471794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 125/256] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:45:13 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:13.646893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:13.647967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:13.655605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.656178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.656728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.657503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.658026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.658583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.803901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:13.817485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-903651eb-ef45-4376-9cb1-5ee02ee27106 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1497 microversion: 2.1 time: 0.175324 Aug 24 06:45:13.818294 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 132/257] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:13 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:13.973726 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:13.974348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:13.980741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.981179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.981614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:13.982309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:13.982795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:13.983242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:14.124908 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:14.136565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bca1d70c-7a77-4d89-b8d1-2132d6708bab tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.166390 Aug 24 06:45:14.137202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 126/258] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:13 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:15.158110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:15.158791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:15.161203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:15.166596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.167079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.167579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.168279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:15.168737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:15.169315 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:15.185176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:15.304184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:15.312882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7d91dc08-46ac-4ed1-91b5-f391552991c6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.158910 Aug 24 06:45:15.313459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 133/259] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:15 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:16.334101 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:16.334792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:16.337388 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:16.343079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.343690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.344335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.345200 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.345707 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.346146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.485976 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:16.486558 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:16.488866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:16.493315 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.493804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.494249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.494969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.495460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.495869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.497215 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9672fadc-126a-4cd7-8a95-56a36f20ace8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.167181 Aug 24 06:45:16.497797 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 127/260] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:16 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:16.532446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:45:16.618492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-79a610fd-fdbd-4957-9232-b259980ec36f tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 204 len: 0 microversion: 2.1 time: 0.136260 Aug 24 06:45:16.619225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 134/261] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:45:16 2022] DELETE /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:45:16.627740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:16.628350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:16.637272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.637776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.638213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.639116 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:16.639656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:16.640229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:16.773543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:16.782313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fb6b8114-463e-4424-b24b-2d4408bfa904 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1503 microversion: 2.1 time: 0.158364 Aug 24 06:45:16.782991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 128/262] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:16 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:16.997597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db3860c1-6e95-413a-a0f6-462fa2319c3a"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:17.000017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:17.005887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.006367 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.006805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.007523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.007979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.008406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.143666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:17.520620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:17.521535 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:17.531342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.531831 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.532271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.532969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.533440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.533868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.537876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:17.678600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:17.687257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-11f6bfc0-1234-4114-8ffb-bf79b9ded52e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.171821 Aug 24 06:45:17.687735 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 129/263] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:17 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:17.809159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:17.810058 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:17.820756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.821581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.822292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.823579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:17.824329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:17.825042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:17.977113 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:17.985760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ef1cb223-78c0-4935-9958-46ec32d0dcf0 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1503 microversion: 2.1 time: 0.183489 Aug 24 06:45:17.986460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 130/264] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:17 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:18.708736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:18.709454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:18.717080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:18.717632 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:18.718311 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:18.719282 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:18.719985 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:18.720521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:18.885578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:18.894846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-059c93e7-692b-436a-8b4b-699632cc7b49 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.190160 Aug 24 06:45:18.895458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:18 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:19.007849 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:19.008612 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:19.015409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.016299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.016618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.017363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.017913 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.018373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.023508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-35f54841-24ca-4b87-8031-ad278540db25 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.030132 Aug 24 06:45:19.024846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 135/266] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:45:16 2022] POST /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments => generated 194 bytes in 2033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:45:19.491330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:19.510153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d8f7dbf0-55dd-4a51-95a4-3b44879d0f8b tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1503 microversion: 2.1 time: 0.506797 Aug 24 06:45:19.523335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 132/267] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:19 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1503 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:19.802731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8700da6-0186-42ab-98ec-9c188518ea87", "name": "network-vif-deleted", "tag": "b69c453d-3284-4bf2-bb2d-015b6bca278f"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:19.818026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.818509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.818934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.831097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] Creating event network-vif-deleted:b69c453d-3284-4bf2-bb2d-015b6bca278f for instance c8700da6-0186-42ab-98ec-9c188518ea87 on hv-cinder-85427 Aug 24 06:45:19.836053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-4d5c3443-f108-4617-9484-b757861a4b01 req-61479f32-f168-4f38-8565-87e21f120955 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Aug 24 06:45:19.836717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 136/268] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:19.837262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:19.837830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:19.848451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.849077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.849423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.850207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.850691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.851118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.876866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ba6d0d90-d388-4f49-80ce-96184a3dd7f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/ips" status: 200 len: 144 microversion: 2.1 time: 0.044697 Aug 24 06:45:19.877775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 133/269] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:45:19 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:19.888461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:19.889045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:19.896056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.896552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.896993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.897707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.898166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.898597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.916664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:19.917280 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:19.924125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.924744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.925244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.925974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:19.926471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:19.926905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:19.927912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9fcae04a-9576-4dcd-af68-2bd77d8be1f6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/ips" status: 200 len: 151 microversion: 2.20 time: 0.043583 Aug 24 06:45:19.928808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 137/270] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 24 06:45:19 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:45:20.098800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:20.110098 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d61352fc-42e4-436a-9227-f8c4d20468b2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.196937 Aug 24 06:45:20.111716 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 134/271] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:19 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:20.533465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:20.534300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:20.541315 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:20.542014 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:20.542532 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:20.543511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:20.544060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:20.544562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:20.617111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:20.627884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c01546b7-17d4-4d55-8a28-5f82573b2491 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1461 microversion: 2.1 time: 0.098511 Aug 24 06:45:20.628803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 138/272] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:20 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:21.137308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:21.137941 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:21.144918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.145419 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.145863 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.146567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.147022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.147490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.305733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:21.316941 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-df61a5ba-7050-4af3-bbf3-6e3d2480b293 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.183941 Aug 24 06:45:21.317462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 135/273] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:21 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:21.648864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:21.649467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:21.656757 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.657273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.657705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.658391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:21.658842 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:21.659293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:21.726835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:21.734941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a53be66f-4888-4f14-a1b2-3fcff35d6d3c tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1461 microversion: 2.1 time: 0.089919 Aug 24 06:45:21.735716 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 139/274] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:21 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:22.338210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:22.338933 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:22.346286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.346910 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.347504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.348565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.349354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.349929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.501126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:22.509250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-aff6e5fe-c120-4b59-afee-32a3f1645a8b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.175217 Aug 24 06:45:22.509912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 136/275] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:22 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:22.756556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:22.757167 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:22.764077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.764567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.765007 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.765804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:22.766264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:22.766792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:22.835078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:22.843346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4a7c888a-b941-4422-8761-677bba75c728 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1461 microversion: 2.1 time: 0.090446 Aug 24 06:45:22.843814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 140/276] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:22 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:23.533705 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:23.550264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:23.578473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.592174 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.592994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.595081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.595948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.596664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.770799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:23.778871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e0b3ec63-2f48-4d27-8f65-33366c368d71 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.252148 Aug 24 06:45:23.779596 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 137/277] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:23 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:23.869065 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:23.870834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:23.879165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.879863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.880645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.881748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.882781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.883707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.933727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:23.934305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:23.935094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:23.935959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lazy-loading 'fault' on Instance uuid c8700da6-0186-42ab-98ec-9c188518ea87 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:45:23.998169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814c0227c728493ebd4364bc154cee83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0930b613a69749d3bc05240e88f74ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:24.006465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d2254bd4-5fb9-4f92-a4f0-747c6877f1d4 tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 200 len: 1303 microversion: 2.1 time: 0.145526 Aug 24 06:45:24.007599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 141/278] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:23 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:24.802414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:24.803039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:24.812424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.813251 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.813646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:24.814348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.814807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.815308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:24.936119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:24.937225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:24.943581 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.944314 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.944758 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:24.945466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.945941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.946353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:24.970418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:24.971607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lazy-loading 'flavor' on Instance uuid 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:45:24.978514 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-51d59c65-41bf-4db3-9fb2-462d1e7f3bdd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.182335 Aug 24 06:45:24.979094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 138/279] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:24 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:24.983751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fa06eb2-8248-4e69-a865-363e604e1eca"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:24.986440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:24.992333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.992948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.993439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:24.994214 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:24.994700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:24.995186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.164368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6be70e4a-4519-40ab-b8a2-0f0020a373a4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/action" status: 202 len: 0 microversion: 2.20 time: 0.232544 Aug 24 06:45:25.165395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 142/280] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 06:45:24 2022] POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:45:25.172362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:25.173380 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] [instance: c8700da6-0186-42ab-98ec-9c188518ea87] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:25.179714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.180196 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.180615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.181309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.181759 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.182178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.196656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] HTTP exception thrown: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Request method failure captured: Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 HTTP/1.1 Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcjQEHwF1l3F-DZE9Rzc6MtnZ292GvbTgxiQ45bH9IJWPddPLGfRDOT3snogUlR8hCh5YPddf6V1Ehfn0FMxLoLfn_0iSJFoCtenRJNx-KeFhqSzIs1AL1VuWFQtc81sqK-zlvHPJq0PsNQ6tpxbJmGKbSsK_QlkGq8_CkylDE6EKKY Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0930b613a69749d3bc05240e88f74ccc Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesActionsTest-2076595470 Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:45:25.198202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0930b613a69749d3bc05240e88f74ccc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0930b613a69749d3bc05240e88f74ccc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesActionsTest-2076595470 Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0930b613a69749d3bc05240e88f74ccc Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesActionsTest-2076595470 Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesActionsTest-2076595470-project Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 814c0227c728493ebd4364bc154cee83 Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesActionsTest-2076595470-project Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. Aug 24 06:45:25.199672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'c8700da6-0186-42ab-98ec-9c188518ea87'} Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:45:25.200456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. Aug 24 06:45:25.201854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:25.203108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] Returning 404 to user: Instance c8700da6-0186-42ab-98ec-9c188518ea87 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:45:25.203108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-dab4e0b6-27c2-40bf-9be6-dd0a5c9118cf tempest-VolumesActionsTest-2076595470 tempest-VolumesActionsTest-2076595470-project] 10.222.0.52 "GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87" status: 404 len: 111 microversion: 2.1 time: 0.032934 Aug 24 06:45:25.203108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 143/281] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:25 2022] GET /compute/v2.1/servers/c8700da6-0186-42ab-98ec-9c188518ea87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:45:25.204665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:25.205270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:25.219081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.219731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.220272 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.221595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:25.222264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:25.222856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:25.358306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.367015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.368558 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:25.369737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-97180b72-e0d0-4c67-9f0d-9fc1e5f78d4a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.168798 Aug 24 06:45:25.370289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 144/282] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:25 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:25.999446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:26.000071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:26.006742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.007266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.007705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.008403 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.008863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.009290 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.141980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.152878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-380cc947-f554-4932-8c58-17a2b08ad858 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.157291 Aug 24 06:45:26.153536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 145/283] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:25 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:26.398162 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:26.399180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:26.408816 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.409304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.409743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.410444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:26.410898 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:26.411355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:26.428638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:26.555344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.565220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.566709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:26.567969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f6df1c47-8740-41b8-a85b-bf092e931eba tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.177338 Aug 24 06:45:26.568692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 146/284] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:26 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:27.177899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:27.178874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:27.189665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.190146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.190566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.191251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.191724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.192145 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.485084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.493612 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3d21fc8b-0a0f-44d9-a5c2-5c60e58f1642 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.322037 Aug 24 06:45:27.494213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 147/285] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:27 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:27.592042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:27.592744 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:27.600017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.600529 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.600967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.601658 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:27.602117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:27.602541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:27.746302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.755245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.756773 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:27.757943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-162c3510-1dd4-4e8e-8415-f0a279294981 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.169894 Aug 24 06:45:27.763235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 148/286] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:27 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:27.942995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bf6b87bf-93de-4142-8990-df7c3cd67a03 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.962540 Aug 24 06:45:27.943648 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 139/287] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:45:24 2022] POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments => generated 194 bytes in 2964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:28.515677 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:28.517103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.525011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.525525 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.525995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.526773 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.527350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.527829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.665204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.675072 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-faa61cc0-b0aa-46b1-9103-06dcc29bd784 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1502 microversion: 2.1 time: 0.163950 Aug 24 06:45:28.675756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 149/288] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:28 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:28.699016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "422b04a9-b107-42de-b3d6-87cf28744d2b"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:28.701464 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.713355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.713984 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.714432 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.715553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.716268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.716698 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.741774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] HTTP exception thrown: Cannot 'attach_volume' instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 while it is in vm_state rescued Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Request method failure captured: Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/os-volume_attachments HTTP/1.1 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 74 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciMQYxqjFL4J9c0ZNOclwwwII2pfCT0ojww9qU3GEWvw2d1CAhFiZ4d43cu0uE7JMqYjokRA0unRqyMAewphhEmMwX61Q0JjEFYuqnQSphqrmxPe9dbO721l1_LZFCY1Pzh1K6v1fC7uVnkaDAUT5HAk9QUUDvStQeLFhREoCMx1tM Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:45:28.743532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a401374685240dc94fe28ca99ad4e11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 2c917c21c7974c8d9746e8b05d9c8b9f Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {"volumeAttachment": {"volumeId": "422b04a9-b107-42de-b3d6-87cf28744d2b"}} Aug 24 06:45:28.745019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Cannot 'attach_volume' instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 while it is in vm_state rescued Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'server_id': '8c8a1bf0-8a43-4089-b507-6dba65b29948', 'body': {'volumeAttachment': {'volumeId': '422b04a9-b107-42de-b3d6-87cf28744d2b'}}} Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:45:28.745903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 while it is in vm_state rescued Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:28.747217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 while it is in vm_state rescued Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Returning 409 to user: Cannot 'attach_volume' instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 while it is in vm_state rescued {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-06e2eb4a-b49c-4177-8ec7-1ed408fa14f0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050855 Aug 24 06:45:28.748506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 140/289] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:45:28 2022] POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 06:45:28.754396 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:28.754937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.761047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.761547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.761988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.762684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.763146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.763610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.781613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:28.782132 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.788558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.789053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.789524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.790368 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.790829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.791293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.841374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9d9335cf-7f41-4ed4-8df1-b01f3258a5c2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/action" status: 202 len: 0 microversion: 2.1 time: 0.090639 Aug 24 06:45:28.842265 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 150/290] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:45:28 2022] POST /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:45:28.851414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:28.852170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:28.858351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.858845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.859436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.860142 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:28.860574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:28.861256 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:28.987762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.997252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:28.998858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:29.000174 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a5b0a956-eb8f-4e97-ab64-aef6d0e3c8bf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.222827 Aug 24 06:45:29.000796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 141/291] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:28 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:29.045627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:29.057615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-305153aa-7d97-4191-ab44-9cda80e7e3d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.210242 Aug 24 06:45:29.072355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 151/292] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:28 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:30.025794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:30.026575 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:30.034637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.035128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.035626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:30.036334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.036793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.037226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:30.080039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:30.080633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:30.089798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.090272 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.090682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:30.091414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:30.091876 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:30.092355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:30.236061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:30.244792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:30.246291 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:30.247512 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-866077fb-7398-436a-b4d8-f7bc26b61f1d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.226772 Aug 24 06:45:30.248068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 142/293] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:30 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:30.273319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:30.284413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e19d5822-6e0f-4f0a-a211-e3915cf19106 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.207858 Aug 24 06:45:30.285091 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 152/294] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:30 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:31.274942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:31.276420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:31.287712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:31.288403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:31.289025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:31.289962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:31.290718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:31.291326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:31.305453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:31.306125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:31.312900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:31.313406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:31.313835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:31.314541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:31.315010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:31.315473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:31.508398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.513125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.518616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.520296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:31.521565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-21213620-26c0-4c51-8a6e-7ec0292ac5e3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.252223 Aug 24 06:45:31.533507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 143/295] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:31 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:31.534089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-868e38d0-273b-4c2f-9ec4-668178b6488a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.222514 Aug 24 06:45:31.534089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 153/296] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:31 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:32.545637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:32.546369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:32.549476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:32.551319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:32.554304 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.555142 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.555335 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.555961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.556449 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.556847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.558878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.559414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.560027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.560975 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:32.562176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:32.562580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:32.770335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.771109 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.778329 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9ffeae71-a7f3-42f9-b345-917f900af14a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.233452 Aug 24 06:45:32.778907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 154/297] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:32 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:32.779993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.781496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:32.782636 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-509190cf-1dd0-475e-aeb3-a30e3e34f610 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.241742 Aug 24 06:45:32.783173 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 144/298] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:32 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:33.799598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:33.800211 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:33.805320 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:33.805962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:33.807252 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.807743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.808176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.808873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.809358 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.809777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.813281 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.813771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.814213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.814918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:33.815421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:33.815835 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:33.820264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:34.009853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.012221 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.018280 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.019835 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:34.020094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0e7ab511-1bf5-403d-b60f-e70d611817a2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.224339 Aug 24 06:45:34.020731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 155/299] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:33 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:34.021352 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4be0bb42-dbb6-4b49-a870-19750ee4e56d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.220232 Aug 24 06:45:34.022151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 145/300] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:33 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:35.041834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:35.043433 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:35.045659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:35.046658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:35.052129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.052849 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.053572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:35.054554 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.055383 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.055851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:35.056367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.057012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.057682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:35.058395 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:35.058856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:35.059312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:35.258611 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:35.262837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:35.270434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7b8635bd-63da-4114-b6fa-4123a53fdf94 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.232829 Aug 24 06:45:35.271254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 156/301] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:35 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:35.274264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:35.275803 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:35.276970 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-41b01e88-5283-4a35-b824-79bf6008a158 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.236555 Aug 24 06:45:35.277546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 146/302] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:35 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:36.295124 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:36.295774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:36.302226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:36.302888 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:36.302988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:36.303444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:36.303910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:36.304610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:36.305071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:36.305600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:36.309585 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:36.310065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:36.310495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:36.311658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:36.312112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:36.312529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:36.510812 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.517641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.519819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.521392 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:36.522630 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d7b984e0-8554-49e3-814d-3fffc71bf22a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.224601 Aug 24 06:45:36.523573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 147/303] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:36 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:36.533528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cf57c091-e31f-4c5c-a601-5b1c03f8c46a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.244796 Aug 24 06:45:36.534190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 157/304] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:36 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:37.551230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:37.551230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:37.559809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.560499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:37.560951 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.561713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.562268 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:37.562829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.563015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.563753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.573034 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.573526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.574376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.577127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:37.577839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:37.578768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:37.781222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.791693 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.793273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.794458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-47546b98-8b16-4be1-b867-3a4001628dd7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.252337 Aug 24 06:45:37.812254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:37.815523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 148/305] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:37 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:37.821089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b49b50e9-2ac9-402a-a9fb-c9dff71c39ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.267431 Aug 24 06:45:37.821663 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 158/306] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:37 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:38.821692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:38.822926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:38.830779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.831319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.831755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:38.832460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.832915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.833337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:38.844666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:38.845924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:38.855303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.856794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.857605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:38.858475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:38.859336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:38.860110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:39.056960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.059304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.068316 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.069082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d7bacd75-2c2a-4bcf-8e0d-76cc8970dfee tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.230753 Aug 24 06:45:39.069659 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 159/307] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:38 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:39.075029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:39.076337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4d0d1a40-c12a-4814-9c33-38ba7263aa05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.259010 Aug 24 06:45:39.080163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 149/308] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:38 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:39.437111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c8ebb2fa-f61c-4cc7-a252-217a349fd186 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: .version_select at 0x7f3dc89edaf0>, body: {"keypair": {"name": "tempest-keypair-2130154578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS/GatyglzNIvUYxYniV+dBav9KT3cCIAbqDoI0lt0jbNUD7HmoG8AsOiRmgSt1GQjVWsecnKYuviv/jASEFCwW2MYDJYMvy6Qtqsa81u1QBPih2kl5Jp9FnLrhSZlsZQ=="}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:39.452377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-c8ebb2fa-f61c-4cc7-a252-217a349fd186 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:45:39.456149 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-c8ebb2fa-f61c-4cc7-a252-217a349fd186 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:45:39.479565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c8ebb2fa-f61c-4cc7-a252-217a349fd186 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046008 Aug 24 06:45:39.480236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 160/309] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:45:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:40.090742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:40.092102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:40.102357 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:40.103699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:40.110078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.113482 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.113951 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.115725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.116214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.117150 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.117768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.118373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.118971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.123234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:40.123956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:40.124588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:40.576780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.579427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.595643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-162f4e3c-9509-488a-af96-cb07f704f6ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.509165 Aug 24 06:45:40.598364 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 150/310] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:40 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:40.632754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.637590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:40.639497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-dcf49d3a-8c91-4ad9-9a51-50f8a7bdbe18 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.541147 Aug 24 06:45:40.655631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 161/311] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:40 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:41.359950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:41.361173 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:41.370557 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.371036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.371676 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.372532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.373128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.373698 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.395508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-883628277", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d764327-7285-4015-bbe3-ebfc93ab6200"}], "security_groups": [{"name": "tempest-securitygroup--1921373253"}], "key_name": "tempest-keypair-2130154578", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:41.576585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] validate_networks() for [('4d764327-7285-4015-bbe3-ebfc93ab6200', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:45:41.585029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lazy-loading 'services' on Instance uuid 7b607344-1425-4d24-9b6f-3b78de61737b {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:45:41.715060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-67b2a4a8-da38-4802-9b08-59c8aff85d3a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b/os-volume_attachments/fd4df78d-f27e-4e21-8cb7-bd78cf4b24ad" status: 202 len: 0 microversion: 2.1 time: 0.359129 Aug 24 06:45:41.715832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 151/312] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:45:41 2022] DELETE /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b/os-volume_attachments/fd4df78d-f27e-4e21-8cb7-bd78cf4b24ad => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:45:41.721880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:41.722801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:41.730058 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.730574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.730999 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.731743 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:41.732206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:41.732694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:41.965576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:41.991451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c7a6eca8-75e1-48ed-b6d6-bd7a67dcfa55 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1510 microversion: 2.1 time: 0.269289 Aug 24 06:45:42.022897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 152/313] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:41 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:42.030611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:42.031277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:42.055453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:42.055995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:42.056415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:42.057431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:42.057979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:42.058607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:42.257924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:45:42.259497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:45:42.262955 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:45:42.263677 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:45:42.264655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:45:42.287119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:42.288197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:42.288839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:42.293208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:42.308889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:42.309358 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:42.310133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:42.310636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:42.312484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:42.313911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0142c07c-64bf-4334-a59a-6e6c05879f2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.289929 Aug 24 06:45:42.329068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 153/314] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:42 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:42.344222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:45:42.349747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:45:42.368273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:45:42.371415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:45:42.441875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6cffdfa9-5caf-4bfa-ae04-0fb4871cf057 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.054983 Aug 24 06:45:42.444486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 162/315] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:45:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:45:42.460890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-df36b5ac-466c-46eb-a85d-0a6e30e70486 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:42.463242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-df36b5ac-466c-46eb-a85d-0a6e30e70486 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:42.555348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df36b5ac-466c-46eb-a85d-0a6e30e70486 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:42.566290 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-df36b5ac-466c-46eb-a85d-0a6e30e70486 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1241 microversion: 2.1 time: 0.111141 Aug 24 06:45:42.566865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 154/316] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:42 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:43.016933 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:43.018382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:43.043282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.043775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.044338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.045327 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.045801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.046351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.311900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.318262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:43.323466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-49c6796a-bd67-4013-bb7b-90821246cb66 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1516 microversion: 2.1 time: 0.312371 Aug 24 06:45:43.324453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 163/317] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:43 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:43.343508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:43.344393 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:43.355528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.356624 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.357250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.358353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.359031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.359694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.590527 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:43.591740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:43.616230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.621842 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.624738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.628044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:43.634712 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:43.636641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:43.648755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.677029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.698426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.698426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2b251468-192b-464c-a02c-79aa0e6ad133 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.352356 Aug 24 06:45:43.698650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 155/318] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:43 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:43.873094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:43.887783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9948273a-1e07-4bd3-a911-0e0a28f19b62 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1293 microversion: 2.1 time: 0.304079 Aug 24 06:45:43.890402 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 164/319] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:43 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1293 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:44.726886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:44.727612 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:44.739144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:44.739964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:44.740563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:44.741438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:44.742234 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:44.742812 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:44.779238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-437722252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-961081060", "security_groups": [{"name": "tempest-secgroup-smoke-293115"}], "networks": [{"uuid": "1a65afdd-a8e2-4518-9256-f6218e06bf95"}], "block_device_mapping_v2": [{"uuid": "bc651a02-6e01-46d6-a3b0-44905e180273", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:45.048855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.050932 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] validate_networks() for [('1a65afdd-a8e2-4518-9256-f6218e06bf95', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:45:45.059274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.071562 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.073061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-819cfda7-1775-47ce-a217-8d247442e21f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1743 microversion: 2.20 time: 0.350896 Aug 24 06:45:45.073630 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 156/320] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:44 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1743 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:45.087129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:45.088162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:45.106832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:45.108584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:45.109208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:45.110420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:45.113979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:45.114592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:45.259479 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:45.267989 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-82d6cf7b-74ea-46db-85b5-df051007daba tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1299 microversion: 2.1 time: 0.187552 Aug 24 06:45:45.268567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 157/321] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:45 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:45.283772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2aedac57-e334-405f-a280-0a07cb88375b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: .version_select at 0x7f3dc8a23280>, body: {"keypair": {"name": "tempest-keypair-1884645197", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZo4KCWuPUrwura8lp+hBiD1r1m9qvGk2yM/17vRK5/wn2empOtbfV1kmvJkqoQPNsexLYR3Ka7c88gvvmtEkpHRTGdbBQ0OyfoMgIrr+klUAtHeB29HwetcisYO4m8kA=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:45.315287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-2aedac57-e334-405f-a280-0a07cb88375b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for project 2a401374685240dc94fe28ca99ad4e11. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:45:45.349637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-2aedac57-e334-405f-a280-0a07cb88375b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for user 2c917c21c7974c8d9746e8b05d9c8b9f and project 2a401374685240dc94fe28ca99ad4e11. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:45:45.410851 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2aedac57-e334-405f-a280-0a07cb88375b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141220 Aug 24 06:45:45.412463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 158/322] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:45:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:45.413923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:46.104370 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:46.105851 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:46.119776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.120569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.121185 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.123666 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.124299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.124883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.146444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:45:46.147404 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:45:46.148025 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:45:46.148579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:45:46.149207 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:45:46.169739 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.170620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.171228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.172286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.173934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.174528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.238591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Getting quotas for project 0bf38c354bea44f5a503e76fa53b20f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:45:46.242746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Getting quotas for user 7957b80bf6e843d4a7a0b11f13a80db8 and project 0bf38c354bea44f5a503e76fa53b20f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:45:46.425264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.437025 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:45:46.439958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.440112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc651a02-6e01-46d6-a3b0-44905e180273',volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:45:46.441562 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:46.442747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c82c5579-6ce2-495d-bdbd-daebad52df1f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1743 microversion: 2.20 time: 0.345341 Aug 24 06:45:46.443321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 159/323] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:46 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1743 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:46.452298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:46.454957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:46.490495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:46.492039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.492522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.492953 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.493651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:46.494213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:46.494817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:46.819003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-821e3343-ad1c-4c60-b3a1-7ff22f1ef214 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.044235 Aug 24 06:45:46.833211 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 165/324] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:45:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:45:46.839049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-da58a776-a741-42f4-ae55-6ff2704e11ac tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:46.839713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-da58a776-a741-42f4-ae55-6ff2704e11ac tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:47.043029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.051580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fb1f4e26-3917-44ab-a2b9-285635931183 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.603595 Aug 24 06:45:47.052191 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 160/325] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:46 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:47.062464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-da58a776-a741-42f4-ae55-6ff2704e11ac tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.077236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193f97ea-0a83-4ece-9176-c200ed18a07d", "tag": "7f6226b0-8d94-4788-b98d-169d64e666d4"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:47.089137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-da58a776-a741-42f4-ae55-6ff2704e11ac tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1087 microversion: 2.1 time: 0.253130 Aug 24 06:45:47.090408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 166/326] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:46 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1087 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:47.125188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.125872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.126313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:47.167114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] Creating event network-changed:7f6226b0-8d94-4788-b98d-169d64e666d4 for instance 193f97ea-0a83-4ece-9176-c200ed18a07d on hv-cinder-85427 Aug 24 06:45:47.193067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-dc9ba1de-f73b-42f5-bf15-1ca0eba836fb req-1ebeb7e6-3e58-47f5-b30b-1f2db4d5d759 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119563 Aug 24 06:45:47.201551 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 161/327] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:45:47.472328 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:47.473726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:47.485676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.491989 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.493706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:47.497446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.500473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.501117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:47.887957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.893591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.894257 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:47.896136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-63463e4f-0925-49e3-a917-280f74affb75 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.430140 Aug 24 06:45:47.897426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 167/328] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:47 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:47.914590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:47.923305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:47.924236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:47.924961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.025151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Going to try to stop instance {{(pid=127290) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:45:48.074167 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.074801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.084068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.089059 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.089513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.090262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.090713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.091143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.153466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:48.195676 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8f53715b-b60d-449d-ae4f-36e26a8d730b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action" status: 202 len: 0 microversion: 2.1 time: 0.299948 Aug 24 06:45:48.204400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 162/329] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:45:47 2022] POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:45:48.254658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.255433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.328262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.328757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.343250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.352401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.355525 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.357094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.503473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:48.527771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-04d8835b-3755-4775-87d8-a6f21cb8646f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.454255 Aug 24 06:45:48.531931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 168/330] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:48 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:48.540862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.541421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.564654 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.567269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.568587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.570058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.571494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.573264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.633106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:48.641982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0f6956ba-129e-45cf-98d9-2761650d59c7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1185 microversion: 2.1 time: 0.419926 Aug 24 06:45:48.646914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 163/331] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:48 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1185 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:48.654591 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "name": "network-vif-plugged", "status": "completed", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:48.667163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.667864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.668302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.705967 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] Creating event network-vif-plugged:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:45:48.719482 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-9c81109c-777b-44a4-8212-25a14be58821 req-b4c8094c-64a2-45f2-8575-c94c0911da3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069560 Aug 24 06:45:48.727874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 164/332] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:48.737070 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.738720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.756601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.759509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.760178 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.760966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.761405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.761838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.827690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:45:48.907853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:48.917396 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9bd8fdd7-b0fc-4c67-9e7c-e168de48b533 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.381103 Aug 24 06:45:48.924285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 169/333] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:48 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:48.948178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:48.949732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:48.962691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.964586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.966326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:48.970290 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:48.974788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:48.975560 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.000406 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-cfd85508-3b14-4204-896e-76b4c073cd33 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 204 len: 0 microversion: 2.1 time: 0.270071 Aug 24 06:45:49.007835 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 165/334] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:45:48 2022] DELETE /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:45:49.034405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:49.035489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:49.056666 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:49.057170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:49.057614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.069226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:49.070363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:49.070878 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.512089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.526608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.531969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.546932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:49.547691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d70e9dda-502f-4d75-adf1-3a308e8729b0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.619215 Aug 24 06:45:49.548965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 170/335] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:48 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:49.564055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:49.564694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:49.568130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-80b355e7-7a58-4a37-a56f-37eba86effba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1513 microversion: 2.1 time: 0.554435 Aug 24 06:45:49.568857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 166/336] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:49 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1513 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:49.585897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:49.586663 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:49.587288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.588336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:49.588955 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:49.589606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:49.654056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1843499586", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ee4b0b1-e8df-4c0b-bdee-5bdfdfc628ad"}], "security_groups": [{"name": "tempest-securitygroup--213422883"}], "key_name": "tempest-keypair-1884645197", "user_data": "}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:50.039550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.090569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-029e7c85-1cf6-4d05-8321-4b1327de73ee tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.540352 Aug 24 06:45:50.091441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 171/337] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:49 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:50.097317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:50.098187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:50.127178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.127724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.128176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.128943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.129435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.129831 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.231711 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.253684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b58ae5e9-fe79-4a94-bdb0-223b37d6f644 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1193 microversion: 2.1 time: 0.160746 Aug 24 06:45:50.254615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 172/338] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:50 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1193 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:50.272549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:50.278238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:50.295097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.297158 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.298351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.299287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.302993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.303913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.555743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:50.562636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7b9c5703-1254-463d-8381-c17fb272fd25 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.305404 Aug 24 06:45:50.563604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 173/339] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:50 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:50.574681 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:50.579314 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:50.582398 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.584480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.584480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:50.584797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:50.585473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:50.586118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.105282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.121719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.126562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.127818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-66eae37e-ed6e-446e-b110-1001befb235c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.558241 Aug 24 06:45:51.130271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 174/340] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:50 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:45:51.139374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:51.140686 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:51.148152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.148868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.149474 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.150644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.151324 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.151903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.443431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.459150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ed6e170e-fe1c-4a38-809b-774469c7b086 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1513 microversion: 2.1 time: 0.326518 Aug 24 06:45:51.472293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 175/341] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:51 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:51.484320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:51.484955 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:51.501420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.503818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.504284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.505021 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.507791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.508277 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.786966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.798974 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-00ab5a06-dc2a-4f78-b405-1e31979a14be tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.325355 Aug 24 06:45:51.800281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 176/342] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:51 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:51.813280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:51.813921 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:51.829209 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.830217 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.832143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.834056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.834717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.835471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.945270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:51.958263 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-94c4bf04-b92a-40ad-8b21-0e445c57e4bc tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1203 microversion: 2.1 time: 0.152709 Aug 24 06:45:51.960438 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 177/343] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:51 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:51.966082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:51.971418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:51.988059 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.989422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.991165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:51.991971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:51.992687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:51.993120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:52.538624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:52.565198 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6b720e76-587d-4e0c-be59-fe46356c8db0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.599368 Aug 24 06:45:52.569308 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 178/344] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:51 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:52.585380 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:52.588520 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:52.606695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:52.607595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:52.608141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:52.609255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:52.609882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:52.610554 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.014368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.026998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.028525 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.029769 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0a4ca184-eb41-4ffd-9924-a9fa1c5a58f0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.458606 Aug 24 06:45:53.030337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 179/345] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:52 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:53.041997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:53.041997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:53.057888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.058699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.059753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.060672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.061812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.062547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.531010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:53.548338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c8085960-12a2-4be5-ad9d-b5d70395d456 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 200 len: 1513 microversion: 2.1 time: 0.516909 Aug 24 06:45:53.562324 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 180/346] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:53 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:53.565545 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:53.567662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:53.586987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.588473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.588724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:53.589479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:53.589949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:53.590389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:54.085131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:54.100829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ece90676-dde6-4d4d-bc9e-b1b79e61e227 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.550769 Aug 24 06:45:54.101703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 181/347] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:53 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:54.108559 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:54.109116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:54.119665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:54.120495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:54.121000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:54.121790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:54.122238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:54.122694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:54.125890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:54.486762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:54.509041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-709f0751-1a95-4e20-afa3-814ed8cc8415 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.404476 Aug 24 06:45:54.510874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 182/348] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:54 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:54.520820 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:54.528650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:54.550514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:54.551016 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:54.551496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:54.552222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:54.552680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:54.555075 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:54.997342 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.015607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8beabbda-388a-4773-bab8-184a43ff46e4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.496718 Aug 24 06:45:55.016484 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 183/349] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:54 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:55.046260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:55.046886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:55.065543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.066041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.066471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.067224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.068336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.071915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.394447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:55.729206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.757495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.777029 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:55.780143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-20458bf4-0707-483e-9f90-0ad1e04f4f37 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.750237 Aug 24 06:45:55.781309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 184/350] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:55 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:55.799108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:55.806786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 7b607344-1425-4d24-9b6f-3b78de61737b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:55.832723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.836963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.843761 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.844631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.853683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.854256 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:55.895317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] HTTP exception thrown: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Request method failure captured: Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b HTTP/1.1 Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcjD_RR7Dk4j1Q2Wu2fuKDXF-pLwfvc6c4C-359z8lg8HU4TN2SzY3Eju1LCK63MqzySUI0n2sYKXylWOrhVWdH4PiTp0o3_yy4phaKtE5qTZ5ahLhcwZ2mwQwjltv52umwC5DmH5ysJOckC3EJJq-1GtMTbP1HZcQ_EVDH3Sl76-VQ Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: b1d68e8e7e104bccb721e3c036a7907a Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:45:55.909266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b1d68e8e7e104bccb721e3c036a7907a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: b1d68e8e7e104bccb721e3c036a7907a Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesSnapshotTestJSON-1107932492-project Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 686bbf803837400e94f1df1efd04a407 Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesSnapshotTestJSON-1107932492-project Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. Aug 24 06:45:55.911140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '7b607344-1425-4d24-9b6f-3b78de61737b'} Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:45:55.912118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. Aug 24 06:45:55.913480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:45:55.917254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Returning 404 to user: Instance 7b607344-1425-4d24-9b6f-3b78de61737b could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:45:55.918496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e93e92c4-f15f-4722-b541-04da47d88b3d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b" status: 404 len: 111 microversion: 2.1 time: 0.135551 Aug 24 06:45:55.926432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 185/351] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:55 2022] GET /compute/v2.1/servers/7b607344-1425-4d24-9b6f-3b78de61737b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:45:55.942080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b607344-1425-4d24-9b6f-3b78de61737b", "name": "network-vif-deleted", "tag": "39027cd7-799c-4639-bf55-55e5d763c37a"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:55.982339 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:55.985808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:55.986374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.021212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] Creating event network-vif-deleted:39027cd7-799c-4639-bf55-55e5d763c37a for instance 7b607344-1425-4d24-9b6f-3b78de61737b on hv-cinder-85427 Aug 24 06:45:56.026913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-f27d89c6-65db-455b-acc7-0f0a7544d69a req-b228d935-51ff-4384-afe9-aebd22a204a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099053 Aug 24 06:45:56.027914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 186/352] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:56.034666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:56.035668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:56.042511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.043387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.044039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.045000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.045688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.046322 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.202481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:56.529143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.550195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-762296f6-a12f-4bf5-8c6d-c32d0f9fe1d5 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.520145 Aug 24 06:45:56.567787 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 187/353] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:56 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:56.585651 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:56.597498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:56.616622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.618039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.618039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.618465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.618900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.625907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.890068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:56.900620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-28625fc1-c6f0-4746-96f2-68008a660895 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.329585 Aug 24 06:45:56.901318 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 188/354] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:56 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:56.920617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:45:56.935708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:56.937145 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:56.937722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:56.957214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] Creating event network-changed:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:45:56.973097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-2aec5778-2d5d-4961-b954-11406089cf3a req-844c59b9-da5d-4209-9c2e-7a3da5703ab1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070520 Aug 24 06:45:56.980176 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 189/355] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:45:56.988265 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:56.988973 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.007721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.008152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.008651 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.009349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.009798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.010229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.087665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=18 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:57.276335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.286809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5147137a-7e22-444e-8124-141a480e558c tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.305230 Aug 24 06:45:57.289998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 190/356] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:56 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:57.308874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:57.309694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.316578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.317292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.317890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.318743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.319385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.319963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.578644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.589464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.591414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.592972 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-dd095e0e-b77f-4197-bc6f-5c84a6b21207 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.288217 Aug 24 06:45:57.593822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 191/357] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:57 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:57.599406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:57.600282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.607470 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.608147 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.608745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.609627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.610217 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.610774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.804471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:57.816746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-844acb33-ccfb-4919-99cc-0a782edb7767 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.221115 Aug 24 06:45:57.817978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 192/358] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:57 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:57.923230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:57.924272 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:57.941943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.943824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.945197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:57.949809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:57.950594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:57.951747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:58.306847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:58.320117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-19bda46f-d22f-4b96-8ade-0257d3a1b3d5 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.402235 Aug 24 06:45:58.320987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 193/359] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:57 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:45:58.383363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:58.390920 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:58.432303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:58.434730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:58.449367 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:58.450489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:58.457066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:58.457910 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:58.824905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:58.838991 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-36a01bb8-a1c0-4c97-8327-9bf75b5bc14a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.480063 Aug 24 06:45:58.855165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 194/360] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:58 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:58.860783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:58.861718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:58.869382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:58.870160 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:58.870775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:58.871714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:58.872346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:58.872925 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.116948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:59.130479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:59.134150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:59.136707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0dc95d1c-d91f-4181-b9e9-3f6e5a94d475 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.278950 Aug 24 06:45:59.142790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 195/361] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:45:58 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:45:59.160696 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:59.161667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:59.168873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.169199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.169642 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.170370 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.170829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.171278 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.532023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:45:59.553008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c64e2464-f3df-4c63-83b4-ee22cbc6a4b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.411322 Aug 24 06:45:59.553807 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 196/362] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:59 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:45:59.555562 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:45:59.582673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:45:59.583708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:45:59.606451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.606959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.607436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.615735 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:45:59.616378 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:45:59.616838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:45:59.701404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:00.098441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:00.112887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bf2c4d44-8a06-482a-ad3f-7a5681672183 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.551675 Aug 24 06:46:00.112887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 197/363] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:45:59 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:00.120815 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:00.121408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:00.163210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.163210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.163210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:00.166102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.166102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.166102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:00.382897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:00.405978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ed3df5a6-60dc-463e-81d9-3b2e6e227c19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.292031 Aug 24 06:46:00.420424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 198/364] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:00 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:00.433339 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:00.453097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:00.467226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.475948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.476498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:00.477478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:00.478298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:00.481794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.079493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:01.094777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:01.096645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:01.098888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c84da9a3-a32a-4f9c-9379-1736f08fd344 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.677112 Aug 24 06:46:01.106069 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 199/365] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:00 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:01.115135 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193f97ea-0a83-4ece-9176-c200ed18a07d", "name": "network-vif-plugged", "status": "completed", "tag": "7f6226b0-8d94-4788-b98d-169d64e666d4"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:01.141082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.141855 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.143064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.180463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] Creating event network-vif-plugged:7f6226b0-8d94-4788-b98d-169d64e666d4 for instance 193f97ea-0a83-4ece-9176-c200ed18a07d on hv-cinder-85427 Aug 24 06:46:01.204188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-dc45e8f4-72ed-493b-be25-3996734ff7cc req-68daf541-54a2-47a6-9ce0-017e8b4e983c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094695 Aug 24 06:46:01.206595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 200/366] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:01.239396 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:01.248508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:01.269722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.270585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.271033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.271790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.272255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.272684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.334746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:01.847547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:01.859090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-88b5559e-65c2-4d77-aab6-d805a85c583f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.646946 Aug 24 06:46:01.861168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 201/367] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:01 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:01.874330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:01.875240 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:01.881742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.889712 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.890437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:01.891962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:01.892603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:01.893225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.132354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.142148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-97462bc4-c458-48a9-be1b-5ca1044d2c58 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.279438 Aug 24 06:46:02.157496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 202/368] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:01 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:02.163141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:02.163809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:02.174936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.175484 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.175907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.176617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.183373 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.184004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.447746 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.458953 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-50346877-8c05-4d90-9fb8-6baee999a8f3 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.300277 Aug 24 06:46:02.463967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 203/369] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:02 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:02.474080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:02.474711 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:02.502839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.505806 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.506276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.507011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.507492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.507924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.812756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.854271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.858773 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:02.866269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-269780f4-362e-459d-acdb-25ec1d2d555e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.400244 Aug 24 06:46:02.868366 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 204/370] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:02 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:02.914609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:02.915585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:02.957285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.957916 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.958462 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:02.959419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:02.959990 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:02.960516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.297953 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:03.306639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e70c71d3-cdaa-41d2-9a2c-2522a94203cb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.397260 Aug 24 06:46:03.312776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 205/371] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:02 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:03.326350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:03.335364 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:03.346907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.347540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.355990 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.361956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.361956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.361956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.633767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:03.644251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e5ca7241-69e7-405c-ad30-55a3796861a8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.330247 Aug 24 06:46:03.645681 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 206/372] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:03 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:03.650444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:03.651319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:03.657980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:03.659888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.660583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.661296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.662344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:03.662926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:03.663479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:03.994618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.004528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-84c86cfb-c14a-44be-a868-11bb4e4df454 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.357682 Aug 24 06:46:04.006993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 207/373] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:03 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:04.023159 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:04.024264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:04.034144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.034950 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.035841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.037343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.038038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.038675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.305409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.325941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.329135 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.331461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a248aa3b-7368-4441-b87e-8b5e4a4e2a55 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.323133 Aug 24 06:46:04.332323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 208/374] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:04 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:04.346218 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:04.347234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:04.357873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.358800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.359496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.360452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.362331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.362964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.631726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.643847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0350a4da-a814-4433-9a0e-c303ba0e9a64 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.303958 Aug 24 06:46:04.644939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 209/375] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:04 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:04.668760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:04.669397 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:04.679264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.679264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.679264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.679264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:04.679766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:04.679766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:04.904683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:04.905130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] validate_networks() for [('4ee4b0b1-e8df-4c0b-bdee-5bdfdfc628ad', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:46:04.917653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f4760675-fc0d-41b2-be2e-3ed6ffd2cdaa tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.255066 Aug 24 06:46:04.932232 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 210/376] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:04 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:05.034050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:05.034601 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.044954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.046088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.047210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.050544 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.051262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.052078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.346371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.361706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0574a192-c846-450e-99d9-604e0b8b454f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.331160 Aug 24 06:46:05.362723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 211/377] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:05 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:05.373647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:05.374813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.387109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.392147 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.392864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.393839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.394525 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.399360 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.630218 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.639273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.640825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.642102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f0d926cd-9c6d-4513-9b23-b506847ef45d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.278313 Aug 24 06:46:05.643060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 212/378] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:05 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:05.663410 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:46:05.663961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:46:05.664519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:46:05.665035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:46:05.665584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:46:05.667233 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:05.667970 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.674878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.675490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.675612 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.676065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.676232 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.676839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.676978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.677478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.677597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.677985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.678094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.678452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.698857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:46:05.703935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Getting quotas for user 2c917c21c7974c8d9746e8b05d9c8b9f and project 2a401374685240dc94fe28ca99ad4e11. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:46:05.721194 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:46:05.723662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:46:05.787039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1727e8dd-3765-4632-a8d8-aaa9853b7620 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 16.137851 Aug 24 06:46:05.788077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 167/379] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:45:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 16140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:46:05.800529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6d170a8a-8b7d-425f-b82b-2fbda62f9a4e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:05.801422 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6d170a8a-8b7d-425f-b82b-2fbda62f9a4e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.877461 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6d170a8a-8b7d-425f-b82b-2fbda62f9a4e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.888694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:05.888909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6d170a8a-8b7d-425f-b82b-2fbda62f9a4e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1246 microversion: 2.1 time: 0.093813 Aug 24 06:46:05.889702 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 168/380] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:05 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:05.909120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-51a01f36-c472-4a42-a8ce-018f378119eb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1367 microversion: 2.1 time: 0.246642 Aug 24 06:46:05.909700 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 213/381] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:05 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:05.945178 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:05.945814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:05.952629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.953139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.953825 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:05.954276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:05.954739 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:05.955169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.100856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.110399 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4ba532f2-ba10-410c-a565-b412413f7ca3 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.169121 Aug 24 06:46:06.110993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 169/382] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:05 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:06.394654 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:06.395477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:06.405431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.406189 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.406851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.407951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.408626 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.409311 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.563234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.574173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-58ce6593-b478-4704-ab06-3810fa0d0e5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.185615 Aug 24 06:46:06.583301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 214/383] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:06 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:06.651431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1021376812", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "networks": [{"uuid": "8c682e0c-d2b1-404f-9302-13fb87fddf13"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:06.669266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:06.669946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:06.682001 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.682497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.682937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.683687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.684146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.684569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.708494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] validate_networks() for [('8c682e0c-d2b1-404f-9302-13fb87fddf13', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:46:06.917055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.927698 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.929157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:06.930330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-83048c32-0c5f-40bb-86c6-375ce3a85735 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1738 microversion: 2.20 time: 0.268888 Aug 24 06:46:06.935247 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 215/384] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:06 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:46:06.936853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:06.937465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:06.945536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.946038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.946503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:06.949917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:06.950407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:06.951037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.035786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.044232 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f195ba25-8e56-47e3-be3f-5d351dd50ad0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1250 microversion: 2.1 time: 0.111293 Aug 24 06:46:07.044903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 216/385] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:06 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1250 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.064421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.065233 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.072692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.073361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.073904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.074714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.075301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.076000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.266225 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:46:07.266679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:46:07.267100 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:46:07.267569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:46:07.267980 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:46:07.277454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.277940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.278371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.279092 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.279690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.280385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.291830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.299679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Getting quotas for project b1d68e8e7e104bccb721e3c036a7907a. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:46:07.300693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ddda8751-e0ea-4bd2-9af4-71c587b6b0ce tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1558 microversion: 2.1 time: 0.247885 Aug 24 06:46:07.301274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 217/386] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.304126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Getting quotas for user 686bbf803837400e94f1df1efd04a407 and project b1d68e8e7e104bccb721e3c036a7907a. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:46:07.306897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.307806 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.314216 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.314878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.315620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.316621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.317032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:46:07.317556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.317837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.319282 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:46:07.320731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:07.368910 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f40f1a5c-cfce-4ab6-baa5-11800926ed22 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723242 Aug 24 06:46:07.369681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 170/387] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:46:07.374549 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.375165 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.381576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.382097 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.382487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.383171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.383813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.384556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.549623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7cbdaf6d-5a8f-4574-9c91-295b1f0116bf tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178535 Aug 24 06:46:07.550271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 171/388] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:07.561599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d7fe0bf3-7db9-4544-b135-da4f794f66c6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.563495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d7fe0bf3-7db9-4544-b135-da4f794f66c6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.573850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.582939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bf77e2d0-67cb-475a-ba0b-bdbdfd90cd22 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.280357 Aug 24 06:46:07.583559 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 218/389] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.605253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.606557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.623235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.626364 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.626805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.627722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.631817 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.632673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.696402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d7fe0bf3-7db9-4544-b135-da4f794f66c6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.705049 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d7fe0bf3-7db9-4544-b135-da4f794f66c6 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1219 microversion: 2.1 time: 0.153455 Aug 24 06:46:07.713521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 172/390] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.897369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:07.907898 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0fd1814f-78d3-48e7-af46-7dfedb6a59bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.306270 Aug 24 06:46:07.909320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 219/391] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:07.959322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:07.960946 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:07.970699 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.971552 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.987502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:07.990100 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:07.990601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:07.991085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.067093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:08.067804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:08.077850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.078533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.078979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.079978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.080762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.081327 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.203568 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:08.230173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ab7a4d0f-4190-4759-ae50-ff844c54dc1e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1298 microversion: 2.1 time: 0.167309 Aug 24 06:46:08.232811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 220/392] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:08 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1298 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:08.267684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:08.279086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:08.280879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:08.282252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f8aeaef7-7b95-4d18-8f1d-066e398b328c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1720 microversion: 2.20 time: 0.330275 Aug 24 06:46:08.296794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 173/393] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:07 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1720 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:08.608074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:08.608710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:08.619935 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.620840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.622881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.623812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.624381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.625261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.741195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:08.741940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:08.759342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.760484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.764080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:08.765218 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:08.765711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:08.766150 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.030320 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.040158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ca2a081a-6cf6-4293-8e0c-485563ed3254 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1271 microversion: 2.1 time: 0.303031 Aug 24 06:46:09.040750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 174/394] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:08 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:09.074399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.075290 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:09.079648 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:09.093042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9232552f-007f-4d6e-b461-d2655c9a0343 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.488490 Aug 24 06:46:09.094938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 221/395] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:08 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:09.099121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.099658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.100102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.100816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.101276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.109686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.252882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:09.253567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:09.265120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.267214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.267808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.271894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.272565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.273363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.405301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.413827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5e6159d7-a3ba-40a7-bcaf-62a296491078 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1304 microversion: 2.1 time: 0.165218 Aug 24 06:46:09.414420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 222/396] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:09 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:09.429493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:09.430438 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:09.439816 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.440497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.441236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.442125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:09.442590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:09.442998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:09.625677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.637513 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c373b440-c591-4687-9f3c-fd3ecbac004e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.574487 Aug 24 06:46:09.638468 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 175/397] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:09 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:09.888275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.903797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.906372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:09.908365 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4909b3e5-cb56-4d61-98cc-74bed522eca4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1720 microversion: 2.20 time: 0.491745 Aug 24 06:46:09.909100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 223/398] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:09 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1720 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:10.059401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "193f97ea-0a83-4ece-9176-c200ed18a07d", "tag": "7f6226b0-8d94-4788-b98d-169d64e666d4"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:10.063170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:10.063998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:10.071779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.073907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.076567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.077285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.080172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.080883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.081440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.081769 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.083478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.103455 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] Creating event network-changed:7f6226b0-8d94-4788-b98d-169d64e666d4 for instance 193f97ea-0a83-4ece-9176-c200ed18a07d on hv-cinder-85427 Aug 24 06:46:10.121663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-6125653f-74c4-41bf-9f51-51703beb1ea5 req-11031e79-a53d-494c-aa0f-9421e6aab203 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065834 Aug 24 06:46:10.122458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 176/399] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:10.132192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:10.137522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:10.157208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.157862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.158404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.159273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.159835 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.160364 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.493959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:10.503954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ba0ccbd1-e10b-48fa-a6d8-1ca601237841 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1277 microversion: 2.1 time: 0.445565 Aug 24 06:46:10.505105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 224/400] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:10 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1277 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:10.511485 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:10.512303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:10.518944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.519717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.520705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.521960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.522620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.523380 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.689594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:10.711918 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a8f6cbbd-8db4-4b7f-a99e-e28a035f821e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1304 microversion: 2.1 time: 0.204308 Aug 24 06:46:10.712719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 225/401] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:10 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:10.724603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:10.725297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:10.738606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.739166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.739757 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.740754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.741413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.741930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.753188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:10.763771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ee03011c-099d-49e3-b689-0e679caaf025 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.636072 Aug 24 06:46:10.780592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 177/402] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:10 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:10.940416 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:10.941215 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:10.951276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.952143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.953032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:10.954029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:10.954756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:10.957842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:11.201036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:11.228307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2ce8199f-dec3-42d1-a48b-dd7ea4ca1b24 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1723 microversion: 2.1 time: 0.514102 Aug 24 06:46:11.228998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 226/403] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:10 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:11.239379 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "name": "network-vif-plugged", "status": "completed", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:11.257863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:11.258375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:11.258808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:11.298366 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] Creating event network-vif-plugged:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:46:11.309449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-c1a675c0-3e47-46be-8341-47bc8077d8ef req-d4049c42-a696-4a1e-8396-6659d78084db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078094 Aug 24 06:46:11.310319 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 227/404] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:11.437752 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:11.485829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:11.488298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:11.493496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-14de83ce-80b8-48dd-ab9b-efadd59669c7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1720 microversion: 2.20 time: 0.562624 Aug 24 06:46:11.494606 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 178/405] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:10 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1720 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:11.537561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:11.538336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:11.557253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:11.558118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:11.558729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:11.559653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:11.560289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:11.560874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:11.736302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:11.736965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:11.755062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:11.755830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:11.756107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:11.757039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:11.757663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:11.758300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.023090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.037384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d1e18336-ee0c-4cab-a7bd-ff84228b650d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.503985 Aug 24 06:46:12.038427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 228/406] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:11 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:12.046174 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:12.047367 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:12.065882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.066389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.066835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.067630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.068206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.068682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.178330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.187447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ec8a2af2-2030-45be-ab3b-e34ca59e0ca7 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.455486 Aug 24 06:46:12.199994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 179/407] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:11 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:12.257905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:12.258629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:12.265035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.265829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.273066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.274223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.274992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.275644 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.518311 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.531148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5827014b-525e-439e-890c-631dff5d9c13 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.489128 Aug 24 06:46:12.544506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 229/408] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:12 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:12.552414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:12.553066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:12.564502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.565006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.565478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.571728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.572384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.572987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.735137 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.749429 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-268c6e0b-75cb-4b9f-8654-b57fb76e7204 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1700 microversion: 2.1 time: 0.494587 Aug 24 06:46:12.750298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 180/409] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:12 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1700 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:12.778900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:12.788096 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.788807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.789751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.833992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Going to try to start instance {{(pid=127290) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:46:12.880298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.890036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9322469d-e79f-4a0f-ad6c-77fbd10c9b81 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action" status: 202 len: 0 microversion: 2.1 time: 0.119663 Aug 24 06:46:12.890494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.891561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 181/410] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:46:12 2022] POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:46:12.898022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2879e7d9-3126-4934-985f-a3604e1ad9b8", "tag": "b2e580d1-d960-416a-a647-59eae23beae0"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:12.898958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:12.903481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-227ea559-1ffb-4a6f-9fc4-fc9dd0630bc9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1663 microversion: 2.20 time: 0.354254 Aug 24 06:46:12.904142 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 230/411] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:12 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1663 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:12.908786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:12.909392 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:12.912661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.913278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.914159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.927613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.928136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.928638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.929369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.929486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] Creating event network-changed:b2e580d1-d960-416a-a647-59eae23beae0 for instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 on hv-cinder-85427 Aug 24 06:46:12.929825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.930426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.937684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-57a38592-bc9b-4f68-a667-c153c7c51b54 req-a881b853-55fb-474f-b876-375be26a7c9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043042 Aug 24 06:46:12.940217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 182/412] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:12.948693 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f469211-a2aa-484c-8277-8a050041941d"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:12.954738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:12.964042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.964778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.965360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:12.966274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:12.966918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:12.967513 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.276408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:13.287304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a1b874d9-eda0-4478-a1c5-4bd68a134335 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1709 microversion: 2.1 time: 0.381804 Aug 24 06:46:13.288159 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 231/413] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:12 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1709 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:13.308619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:13.329497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.330451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.331216 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.350937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] Creating event network-changed:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:46:13.359154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-fc944ea7-b564-4b3e-b92e-ca08a5228b1a req-b366631b-2451-494d-b58a-51771beaa056 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054757 Aug 24 06:46:13.360433 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 232/414] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:13.369298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:13.370569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:13.380520 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.382683 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.384453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.385582 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.387635 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.389590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.434244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bd9e3e1e-1716-4fa1-bb8d-650a18294e35 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.491625 Aug 24 06:46:13.435506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 183/415] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 24 06:46:12 2022] POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 188 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:46:13.445839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:13.446540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:13.454181 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.454664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.455355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.456221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.456867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.457511 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.667371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:13.671599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:13.671822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:13.676928 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e811c0e2-be4e-42dd-988f-6d1d0799496c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.239698 Aug 24 06:46:13.677526 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 184/416] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:13 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:13.682215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6e2c751d-8577-4d11-860b-3ddaa84cccdc tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.320321 Aug 24 06:46:13.683577 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "name": "network-vif-unplugged", "status": "completed", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:13.694779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 233/417] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:13 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:13.697067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.697560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.698320 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.700058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:13.700653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:13.710905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.711569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.712220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.713255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.713662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.714096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.715781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.compute.server_external_events [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] Unable to find a host for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b. Dropping event network-vif-unplugged {{(pid=127290) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 06:46:13.716732 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-4b13fd91-7d58-4d97-9bcf-2ebfb3700792 req-16453040-05d5-4d98-b856-734eb50ddab3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037880 Aug 24 06:46:13.719040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 185/418] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 06:46:13.725790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:13.727641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:13.734219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.734705 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.735683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.736426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.736887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.737477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.793894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127290) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:46:13.886859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1bd6088b-e1c1-4521-bb7a-d395ac930348 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/action" status: 202 len: 0 microversion: 2.20 time: 0.166531 Aug 24 06:46:13.889017 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 186/419] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 06:46:13 2022] POST /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:13.908172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:13.908815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:13.929030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.934112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.935112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.936299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:13.936808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:13.937240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:13.966196 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:13.976270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-419f7a5e-d2d4-4b4f-82ee-df38a1398363 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1255 microversion: 2.1 time: 0.280167 Aug 24 06:46:13.984080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 234/420] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:13 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1255 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:14.312624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:14.313316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:14.324209 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.324713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.325159 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.325891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.328148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.328608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.336561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:14.350976 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:14.358257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:14.360216 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2d6d85ed-39a2-42e3-8889-1448057bd4fc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1749 microversion: 2.20 time: 0.464782 Aug 24 06:46:14.360880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 187/421] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:13 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1749 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:14.667616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:14.679763 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5fea30c9-cb66-4c2d-b1d8-739b8aeb8ddb tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1709 microversion: 2.1 time: 0.373727 Aug 24 06:46:14.688516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 235/422] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:14 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1709 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:14.702647 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:14.703554 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:14.718583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.719537 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.720486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.721286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.721618 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:14.722917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.723300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:14.723922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.739177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.740038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.741055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.743500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:14.746729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:14.747180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:14.750351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:15.282994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.285511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.293911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bdb2f31f-a9f4-4f11-bc14-d6c0138b62f2 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.596332 Aug 24 06:46:15.294845 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 188/423] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:14 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:15.295513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2ec35844-a9e1-4c88-9879-1a069ee85e5d tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.583281 Aug 24 06:46:15.297818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 236/424] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:14 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:15.315969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:15.316645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:15.324365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.324858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.325386 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.326138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.326964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.327492 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.386936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:15.388162 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:15.396661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.397248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.397956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.399297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.400056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.400502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.528414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.538238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-857d39c1-c32e-4a06-a54a-1f9eb8c460e6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1439 microversion: 2.1 time: 0.242314 Aug 24 06:46:15.538860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 189/425] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:15 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1439 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:15.559509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:15.560122 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:15.570451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.571919 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.572793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.573700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.574811 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.575463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.578269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.591068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.593490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.594999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e9ce69be-b157-4f54-9a7d-ddb964de99a2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1749 microversion: 2.20 time: 0.212805 Aug 24 06:46:15.595597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 237/426] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:15 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1749 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:15.709836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:15.710722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:15.718421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.719633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.720204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.721402 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.722130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:15.722788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:15.723736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:15.729579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-799852d5-5a5e-4ece-ae34-8666a82fa068 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1439 microversion: 2.1 time: 0.174168 Aug 24 06:46:15.730231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 190/427] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:15 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1439 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:15.895242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:15.903763 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d5591228-fcaa-44c3-aaa4-c1e47503fa5e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1709 microversion: 2.1 time: 0.197972 Aug 24 06:46:15.904318 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 238/428] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:15 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:16.314517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:16.315766 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:16.318375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:16.319063 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:16.324087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.324576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.325009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.325708 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.326164 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.326727 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.326835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.327429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.327937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.328708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.329722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.330231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.566450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:16.577680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9b5cf65b-03f2-4eba-9936-11d479186f31 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.263201 Aug 24 06:46:16.578491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 239/429] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:16 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:16.598506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:16.610890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c6717348-3dc3-49c2-8a2c-6eb4ea53c1e1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.299742 Aug 24 06:46:16.616082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 191/430] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:16 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:16.628666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:16.629275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:16.636407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.636909 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.637401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.638116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.638580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.639519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.907966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:16.917758 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:16.919266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:16.920531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-84855913-2465-4eb0-8bf0-40d5eee7ac29 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1749 microversion: 2.20 time: 0.295865 Aug 24 06:46:16.927223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:16.928318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:16.936646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 240/431] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:16 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:16.938117 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.939086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.940286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:16.941775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:16.942492 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:16.943445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.199991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:17.234885 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-906beac1-32a4-4ca4-b8a1-8ed31b7fdc66 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1709 microversion: 2.1 time: 0.312771 Aug 24 06:46:17.237609 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 192/432] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:16 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1709 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:17.600965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:17.601597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:17.608019 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.608501 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.608930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.609647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.610576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.610576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.637376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:17.638149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:17.640120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:17.646720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.647233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.647677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.652464 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.653526 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.654451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.704932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=16 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:17.852597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:17.861691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b62180f3-0770-47f8-b3ef-146c429041ba tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.264630 Aug 24 06:46:17.862562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 241/433] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:17 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:17.867767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:17.878774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:17.907390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-cb184b63-83b5-4fed-80a6-7206eb98926a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.275169 Aug 24 06:46:17.909750 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.923298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.923298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.924851 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 193/434] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:17 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:17.944587 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:17.945459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:17.950836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] Creating event network-changed:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:46:17.958632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-9b59e110-6050-44d5-b4ee-2eef7d555eab req-5c4beff6-2daa-4ae0-b58f-832cda73dd58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094473 Aug 24 06:46:17.962660 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.965834 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.966347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:17.968497 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:17.971922 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 242/435] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:17.973207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:17.973690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.260017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:18.261158 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:18.273971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.276729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.277717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.278992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.279939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.280641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.341866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:18.352138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:18.354310 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:18.355756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7ceaa26d-3e64-46f2-89b8-1d0c12f5b73b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1751 microversion: 2.20 time: 0.415168 Aug 24 06:46:18.363706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 194/436] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:17 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1751 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:18.456435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:18.465748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2959c11d-2c18-4e7a-ad00-c00182192883 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1713 microversion: 2.1 time: 0.210249 Aug 24 06:46:18.466345 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 243/437] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:18 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1713 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:18.883076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:18.883767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:18.903540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.904029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.909965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.910732 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.911230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.913118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.934650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:18.935349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:18.959447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.959447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.959447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:18.959447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:18.959811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:18.959811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:19.323783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:19.337217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b2048350-711c-4c07-b4cf-2c886a35b15c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.457535 Aug 24 06:46:19.341276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:19.348578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 195/438] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:18 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:19.350675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-716c0c2c-e59b-409b-9c28-6f9dede4df14 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.420827 Aug 24 06:46:19.351271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 244/439] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:18 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:19.379721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:19.381203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:19.389843 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:19.390462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:19.391027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:19.391897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:19.392454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:19.392975 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:19.598567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:19.609537 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:19.611259 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:19.612519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7ec9a9f9-534f-4dd1-9d16-26027a4f0da7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.237154 Aug 24 06:46:19.613079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 196/440] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:19 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:20.372197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:20.372807 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:20.380127 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:20.380716 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:20.394692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.395285 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.395605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.396302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.397433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.398377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.401656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.402151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.402820 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.403713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.404418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.408364 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.657209 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:20.664271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c3bb6689-72c5-4169-b94c-e95e7f4f0d43 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.287844 Aug 24 06:46:20.666536 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 197/441] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:20 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:20.666848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:20.675070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-85f7b8dc-d10a-4513-bc4f-e34c365cd06a tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.306725 Aug 24 06:46:20.689312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 245/442] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:20 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:20.690243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:20.690243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:20.694931 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:20.696626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.697453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.697838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.698558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:20.699024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:20.699456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:20.889485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:20.899340 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:20.901110 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:20.902295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ead0dab5-d8ae-4138-b846-8dcdc5be408e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.234414 Aug 24 06:46:20.902864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 198/443] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:20 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:21.689015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:21.689634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:21.698272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:21.698852 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:21.698852 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:21.699280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:21.700302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:21.701166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:21.701596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:21.702584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:21.711837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:21.712374 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:21.713094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:21.714038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:21.714926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:21.715790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:22.019088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:22.033897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:22.035537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bedccbf7-1f4d-4e99-aa08-1408571a26eb tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.349222 Aug 24 06:46:22.046861 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 246/444] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:21 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:22.048619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2879e7d9-3126-4934-985f-a3604e1ad9b8", "name": "network-vif-plugged", "status": "completed", "tag": "b2e580d1-d960-416a-a647-59eae23beae0"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:22.052430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e022210e-a65e-4dc7-aef7-ba503507f075 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.359082 Aug 24 06:46:22.066736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 199/445] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:21 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:22.073034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:22.073641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:22.074549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:22.075406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:22.076275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:22.089067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:22.089568 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:22.090009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:22.090764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:22.095043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:22.095637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:22.098900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] Creating event network-vif-plugged:b2e580d1-d960-416a-a647-59eae23beae0 for instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 on hv-cinder-85427 Aug 24 06:46:22.105687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-6003f04b-1ca7-4b65-a584-b0a0e7ac82f0 req-942a4115-fb7f-47f6-b14c-213ac0c909b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067522 Aug 24 06:46:22.106924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 247/446] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:22.276864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:22.286178 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:22.288087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:22.289594 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b54407ce-7806-40bf-b2c3-375cbe776859 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.221725 Aug 24 06:46:22.290427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 200/447] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:22 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:23.066940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:23.069583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:23.079127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.079692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.080334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.081081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.081354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:23.081882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.081995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.082102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:23.089540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.090149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.090454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.094202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.094718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.095158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.099936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:23.304255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:23.318361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a789dc18-3915-42b4-a128-1bcd6c58cfb6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.259267 Aug 24 06:46:23.320082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 248/448] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:23 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:23.327051 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:23.329895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:23.346361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.348860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.350134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.352174 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:23.352941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:23.354342 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:23.355768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:23.360904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a43bef72-9f93-465e-bece-a55b2f92e019 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.283689 Aug 24 06:46:23.364012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 201/449] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:23 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:23.527070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:23.539044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:23.541114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:23.542366 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e7262548-2230-4fe2-bd47-ffb5cae063ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.221229 Aug 24 06:46:23.543003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 249/450] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:23 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:24.135258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "name": "network-vif-plugged", "status": "completed", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:24.145964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.146553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.146988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.158235 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] Creating event network-vif-plugged:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:46:24.163667 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-101f0789-3cf2-4477-a937-924c6764778f req-132b9049-4360-4105-b6cf-9076e581c800 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032135 Aug 24 06:46:24.164271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 202/451] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:24.342884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:24.343705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:24.350615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.351041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.351510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.352187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.352671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.353093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.391344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:24.392471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:24.406056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.406889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.407601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.408512 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.409179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.409786 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.622698 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:24.625738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:24.634807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e9a3de35-f2cd-4889-9088-c229b6d7488c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.249170 Aug 24 06:46:24.636448 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-388780d0-1ffe-46d1-ae09-efddead25903 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.298260 Aug 24 06:46:24.641291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 250/452] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:24 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:24.662843 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:24.662843 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:24.669583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 203/453] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:24 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:24.670051 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.670835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.671577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.672437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:24.673136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:24.674875 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:24.835458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:24.851594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:24.853863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:24.855024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-43d8ce63-03f9-47d2-be52-ed00e9c1d944 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.212818 Aug 24 06:46:24.859238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 251/454] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:24 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:25.676735 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:25.677269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:25.677663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:25.677784 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:25.692497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:25.693246 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:25.693730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:25.693852 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:25.694182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:25.694901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:25.695325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:25.695458 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:25.695787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:25.697813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:25.698374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:25.698866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:26.146645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:26.159503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7bd6d346-6e92-42e4-88d7-0f0e18ebf0f9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.489310 Aug 24 06:46:26.160090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 252/455] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:25 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:26.164870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:26.171420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:26.180125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:26.180647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:26.181274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:26.181979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:26.182609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:26.183172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:26.203042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:26.213222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2a77f321-0837-4150-94c4-c2d9c96df604 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.542818 Aug 24 06:46:26.214642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 204/456] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:25 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:26.352201 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:26.361959 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:26.363561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:26.364782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3a8e090b-8b53-4c95-b911-ab99a0d5f200 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.203489 Aug 24 06:46:26.367517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 253/457] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:26 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:27.181895 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:27.182562 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:27.190326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.190821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.191287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.192000 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.192441 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.192874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.238087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:27.239039 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:27.246353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.247227 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.247895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.248862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.249642 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.250298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.253727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:27.408460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:27.420081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-565b8ee5-c15c-43d1-b8e4-2251a30d6d9f tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.242549 Aug 24 06:46:27.421532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 205/458] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:27 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:27.426638 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:27.427505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:27.434331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.435096 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.435558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.436631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:27.437094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:27.437516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:27.456962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:27.466137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7a680e75-5b46-42e6-86f0-7f1d13baf0cc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.231872 Aug 24 06:46:27.466839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 254/459] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:27 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:27.587223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:27.597758 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:27.599267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:27.600444 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-dc08c595-3d4a-443a-bcaf-04f917b16f64 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.177751 Aug 24 06:46:27.601044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 206/460] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:27 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:28.442762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:28.443447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:28.457237 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.457751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.458212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.458943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.459515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.459948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.495863 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:28.496575 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:28.507727 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.508230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.508739 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.509452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.509911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.510391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.731015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:28.731790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d5b69fa6-2798-40ad-8182-99fd62c2fa47 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.292980 Aug 24 06:46:28.733144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 255/461] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:28 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:28.745595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:28.746569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:28.754339 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.755345 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.756088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.757168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:28.757911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:28.758613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:28.771642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:28.785183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a680a825-bfe7-48b4-8df0-33fdc12e3f96 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.299476 Aug 24 06:46:28.785183 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 207/462] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:28 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:28.963391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:28.972694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:28.974300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:28.975586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-99a667ea-a7e6-4698-a7bc-2af57ede220f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.241038 Aug 24 06:46:28.976152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 256/463] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:28 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:29.757689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:29.758336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:29.766318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:29.766943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:29.767457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:29.768172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:29.768649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:29.769084 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:29.804886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:29.805668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:29.808730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:29.818963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:29.819518 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:29.820082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:29.820850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:29.821452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:29.821939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:29.958310 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:29.967327 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6446b9ce-adbf-4004-a61b-ae65e52f927c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.213582 Aug 24 06:46:29.968103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 208/464] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:29 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:29.998752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:30.002661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:30.003303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:30.014810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-610505ea-22a7-45ba-9768-e7786d6c236a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.213706 Aug 24 06:46:30.019541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.020135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:30.020693 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:30.021259 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.021711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:30.022203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:30.025905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 257/465] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:29 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:30.163067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:30.172146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:30.173611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:30.175020 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-12aa18db-60cc-4936-b5c8-09d4f052773c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.180114 Aug 24 06:46:30.175614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 209/466] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:29 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:30.990395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:30.991172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:30.999457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:30.999949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.000388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.001089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.001546 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.001992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.048172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:31.048741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:31.057833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.058336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.058768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.059545 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.060007 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.060442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.197717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:31.205965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fa328df3-6e77-48a2-9114-b17867818831 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.220936 Aug 24 06:46:31.206543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 258/467] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:30 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:31.211879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:31.212493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:31.218966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.219496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.219935 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.220859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:31.221330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:31.221735 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:31.241403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:31.249905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9bc86536-bc95-459d-8560-1ddf41d22b91 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.208437 Aug 24 06:46:31.250422 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 210/468] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:31 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:31.361336 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:31.370941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:31.372710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:31.374128 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4626c61c-6b7c-429b-bea9-40b44c1851f7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.166450 Aug 24 06:46:31.375024 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 259/469] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:31 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:32.227454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:32.228041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:32.235393 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.235877 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.236308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.236959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.237438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.237860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.270998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:32.271771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:32.278822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.279440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.279957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.280671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.281132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.281576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.430070 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.438903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c2178fbd-0573-4c45-be03-1822e4c7c9aa tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.215380 Aug 24 06:46:32.439535 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 211/470] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:32 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:32.446956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:32.447652 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:32.453897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.454386 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.454828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.455614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:32.456006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:32.456432 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:32.458433 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.467042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4ca84e3a-ce4a-4fa8-a369-d13c26636f2c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1371 microversion: 2.1 time: 0.199826 Aug 24 06:46:32.467678 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 260/471] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:32 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:32.592681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.601965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.603510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:32.604899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ba8bb3c0-edb0-4510-b506-a6da0ce7dd78 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.161604 Aug 24 06:46:32.605440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 212/472] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:32 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:33.460444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:33.461125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:33.468560 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.468560 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.470430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.471166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.471689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.472061 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.488317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:33.492939 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:33.501015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.501936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.502671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.504167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.504600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.505938 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.685096 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.693799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0fedb6ec-b716-4e5e-a226-eabf2c41d457 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1319 microversion: 2.1 time: 0.237522 Aug 24 06:46:33.694504 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 261/473] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:33 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:33.700568 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:33.701170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:33.707630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.708475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.709083 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.709825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.710398 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.710824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.719722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.729704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-61b4e04d-ba39-4cd8-9466-d66ff96defea tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1565 microversion: 2.1 time: 0.245060 Aug 24 06:46:33.730461 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 213/474] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:33 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:33.752278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:33.752870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:33.759254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.760048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.760911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.761983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:33.762522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:33.763032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:33.871244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6f51cf3d-93fe-4a62-968f-03f8822eb32b tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123261 Aug 24 06:46:33.872219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 214/475] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:46:33 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:33.907690 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.916895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.918542 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:33.919809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9ec93c2d-2087-45d2-b596-8791a64d69c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.224123 Aug 24 06:46:33.920369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 262/476] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:33 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:34.715529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:34.716145 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:34.723634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.724494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.724933 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.725735 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.726487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.726882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.915434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:34.925166 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7225c07e-f135-4d36-8091-55edb8a69a1c tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1508 microversion: 2.1 time: 0.213486 Aug 24 06:46:34.925998 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 215/477] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:34 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:34.949322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45f13d30-0dfa-4baa-bbad-936156d1d329", "device": "/dev/sdb"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:34.952193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:34.952808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:34.958610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:34.966284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.966931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.967710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.968206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.968934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.969057 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.969530 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.969933 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.970056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:34.970981 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:34.971670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:34.972309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:35.181426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:35.201534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:35.204793 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:35.209366 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-76455f9a-0552-45d6-bda3-5a35dbf42ae2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.268668 Aug 24 06:46:35.212467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 263/478] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:34 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:35.219161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:35.239756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:35.240252 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:35.240698 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:35.277388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] Creating event network-changed:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:46:35.284392 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-60191003-7346-4549-94db-300506cf7e3b req-895b2ed7-33d7-4c57-8150-c57c6e88c65c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068687 Aug 24 06:46:35.284996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 264/479] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:35.504782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a8b724dc-3c6e-4e31-84c2-8c48eea9a023 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "POST /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561329 Aug 24 06:46:35.505916 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 216/480] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:46:34 2022] POST /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8/os-volume_attachments => generated 194 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:36.236531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:36.238293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:36.245670 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:36.246457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:36.247019 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:36.248268 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:36.248995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:36.249487 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:36.459116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:36.472662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:36.474103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:36.475312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b35ac30b-d8c6-464a-877f-36f0aa81a4e9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.245108 Aug 24 06:46:36.475877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 265/481] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:36 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:37.504776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:37.505947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:37.516860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:37.517671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:37.518385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:37.519607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:37.520376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:37.521092 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:37.541426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:37.664913 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:37.674491 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:37.676013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:37.677172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ee517c8e-2ba1-485f-9b94-91d86176f0d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.180484 Aug 24 06:46:37.677748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 217/482] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:37 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:38.701105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:38.701845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:38.709483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:38.709866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:38.711458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:38.712165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:38.712633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:38.713255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:38.850797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:38.860475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:38.861985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:38.863161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a6cea8d9-dfc7-4136-b15c-31b7864c48a6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.166176 Aug 24 06:46:38.863788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 266/483] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:38 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:39.890295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:39.891360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:39.902268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:39.902754 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:39.903211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:39.903932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:39.904391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:39.904819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:40.053228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:40.062847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:40.064372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:40.065528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a0646b27-ada2-448d-acb8-48ee3f5d9733 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.181775 Aug 24 06:46:40.066401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 218/484] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:39 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:40.812723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "name": "network-vif-plugged", "status": "completed", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:40.822930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:40.823436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:40.824717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:40.836721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] Creating event network-vif-plugged:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:46:40.841713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-11d1d77d-5665-423f-9266-fba59ea8bab3 req-ff0f8c81-42b8-4008-833e-29eb1b0581be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034850 Aug 24 06:46:40.842510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 267/485] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:41.093297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:41.094149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:41.105006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:41.105491 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:41.105923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:41.106627 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:41.107086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:41.107540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:41.253518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:41.268108 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:41.270195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:41.271989 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-51162cae-84e9-4910-844f-16e474533205 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.185277 Aug 24 06:46:41.272763 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 219/486] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:41 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:42.301404 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:42.302460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:42.311629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.312114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.312553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.313253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.313710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.314500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.491326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:42.502727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:42.504692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:42.506137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-38da3912-cbec-4b79-a46b-2b3ef1de6230 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.211604 Aug 24 06:46:42.506730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 268/487] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:42 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:43.531279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:43.531988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:43.538727 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.539222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.539672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.540368 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.540822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.541247 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.694595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.707413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.709637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.711401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f550309b-ce72-407d-b3b5-add0e44bbf43 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.183903 Aug 24 06:46:43.712121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 220/488] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:43 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:44.736102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:44.736741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:44.743234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.743732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.744173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.744864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.745479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.746084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.889080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.901813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.904044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.905833 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fb61e2ba-2460-4d0d-9c18-a39e40e803f9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.174059 Aug 24 06:46:44.906598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 269/489] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:44 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:45.934040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.934642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.942066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.942558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.943000 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.943709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.944192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.944621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.089730 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.103300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.105360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.106538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f381948e-bcb7-4ec0-90d0-947d1b26f045 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.178686 Aug 24 06:46:46.107108 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 221/490] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:47.133547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:47.134558 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:47.141785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.142264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.142704 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.143430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.143880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.144300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.281488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.295667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.298402 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.300355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0f2a8a40-ac2f-4779-9b4e-3f839ca74fbf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.173054 Aug 24 06:46:47.301232 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 270/491] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:47 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:48.331830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:48.332822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:48.344186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.344976 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.345689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.346824 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.347629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.348312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.496042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:48.504877 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:48.506360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:48.507553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e7b1c00a-bf71-4699-b47a-b5034ba735ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.182849 Aug 24 06:46:48.508157 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 222/492] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:48 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:49.533418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:49.534036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:49.540975 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.541456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.541887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.542572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:49.543357 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:49.543841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:49.678862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:49.688606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:49.690100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:49.691281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6fce9ca4-9af0-4c5d-a453-569c2b9390c3 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.161871 Aug 24 06:46:49.691815 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 271/493] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:49 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:50.714339 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:50.716417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:50.722945 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:50.723574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:50.724030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:50.724829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:50.725314 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:50.725747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:50.861231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:50.874394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:50.876788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:50.878560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e75d36a2-3e23-48f2-beaf-2ab884277b49 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1807 microversion: 2.20 time: 0.168146 Aug 24 06:46:50.879442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 223/494] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:50 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:51.905743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:51.906320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:51.913133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:51.913624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:51.914037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:51.914815 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:51.915344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:51.915785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:51.919153 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:52.064899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:52.073929 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:52.075943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:52.077198 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c81139ab-7c2c-4b8b-aa81-ef73316a3062 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1794 microversion: 2.20 time: 0.176905 Aug 24 06:46:52.077753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 272/495] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:46:51 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1794 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:46:55.023842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.024366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.026706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=52 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:55.032463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.032945 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.033378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.034060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.034511 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.034938 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.123628 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lazy-loading 'services' on Instance uuid 2879e7d9-3126-4934-985f-a3604e1ad9b8 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:55.215949 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bb191d85-ea80-4f56-8864-c327c881d4b1 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8/os-volume_attachments/45f13d30-0dfa-4baa-bbad-936156d1d329" status: 202 len: 0 microversion: 2.1 time: 0.195787 Aug 24 06:46:55.216571 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 224/496] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:46:55 2022] DELETE /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8/os-volume_attachments/45f13d30-0dfa-4baa-bbad-936156d1d329 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:56.352877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:56.353519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:56.360354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.360850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.361287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.361964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.362460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.362889 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.388797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:56.470322 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6ecda50e-59f6-43b8-95ff-ab9ece43b0a2 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 204 len: 0 microversion: 2.1 time: 0.121348 Aug 24 06:46:56.471021 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 273/497] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:56 2022] DELETE /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:56.480483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:56.481181 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:56.488229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.488706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.489143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.489832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.490287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.490709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.639821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:56.648088 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3b4a7796-fc71-4acd-8060-724450bcf6b9 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1514 microversion: 2.1 time: 0.172410 Aug 24 06:46:56.648659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 225/498] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:56 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:57.675534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:57.676765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:57.687557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.688050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.688497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.689195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:57.689692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:57.690121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.827754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:57.835639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-567a5dcc-ee09-48a5-89b6-c61aac63c1bd tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1514 microversion: 2.1 time: 0.167929 Aug 24 06:46:57.836209 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 274/499] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:57 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:58.862518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:58.863228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:58.870712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.871286 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.871780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.872560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.873073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.873547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.103385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686bbf803837400e94f1df1efd04a407', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d68e8e7e104bccb721e3c036a7907a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:59.111548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0ab2da6e-df73-42d0-9b9f-9ccda4976317 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 200 len: 1514 microversion: 2.1 time: 0.256034 Aug 24 06:46:59.112115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 226/500] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:58 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:59.460174 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2879e7d9-3126-4934-985f-a3604e1ad9b8", "name": "network-vif-deleted", "tag": "b2e580d1-d960-416a-a647-59eae23beae0"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:59.471796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:59.472273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:59.472700 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.484958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] Creating event network-vif-deleted:b2e580d1-d960-416a-a647-59eae23beae0 for instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 on hv-cinder-85427 Aug 24 06:46:59.489915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-26b6fe7d-6cbc-415b-ae39-266297fec2f9 req-3f4a01d3-0eac-43c7-8c59-24f141ba7465 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Aug 24 06:46:59.490514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 275/501] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:00.136421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:00.137030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] [instance: 2879e7d9-3126-4934-985f-a3604e1ad9b8] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:00.144113 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.144616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.145044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.145721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.146236 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.146671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.160785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] HTTP exception thrown: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Request method failure captured: Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 HTTP/1.1 Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjD_RR7Dk4j1Q2Wu2fuKDXF-pLwfvc6c4C-359z8lg8HU4TN2SzY3Eju1LCK63MqzySUI0n2sYKXylWOrhVWdH4PiTp0o3_yy4phaKtE5qTZ5ahLhcwZ2mwQwjltv52umwC5DmH5ysJOckC3EJJq-1GtMTbP1HZcQ_EVDH3Sl76-VQ Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: b1d68e8e7e104bccb721e3c036a7907a Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:47:00.162423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b1d68e8e7e104bccb721e3c036a7907a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b1d68e8e7e104bccb721e3c036a7907a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: b1d68e8e7e104bccb721e3c036a7907a Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1107932492 Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesSnapshotTestJSON-1107932492-project Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 686bbf803837400e94f1df1efd04a407 Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesSnapshotTestJSON-1107932492-project Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. Aug 24 06:47:00.164124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '2879e7d9-3126-4934-985f-a3604e1ad9b8'} Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:00.165206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. Aug 24 06:47:00.166681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:00.168037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] Returning 404 to user: Instance 2879e7d9-3126-4934-985f-a3604e1ad9b8 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:00.168037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-114c9076-0ed4-4da7-b4a5-e0b8da0bd036 tempest-VolumesSnapshotTestJSON-1107932492 tempest-VolumesSnapshotTestJSON-1107932492-project] 10.222.0.52 "GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8" status: 404 len: 111 microversion: 2.1 time: 0.031394 Aug 24 06:47:00.168037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 227/502] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:00 2022] GET /compute/v2.1/servers/2879e7d9-3126-4934-985f-a3604e1ad9b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:47:13.800163 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:13.800969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:13.805650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.806325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.815346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.815942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.816569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.817269 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.817731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.818160 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.844100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fe0f9502-4af7-4266-95a0-af52bd908399 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/ips" status: 200 len: 151 microversion: 2.1 time: 0.045959 Aug 24 06:47:13.844586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 276/503] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:47:13 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:13.861745 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db3860c1-6e95-413a-a0f6-462fa2319c3a"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:13.864680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.867808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=7 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:13.868542 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:13.876452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.876939 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.877371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.878065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.878515 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.878934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.962743 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: POST /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/os-volume_attachments HTTP/1.1 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 74 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:47:13.964503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {"volumeAttachment": {"volumeId": "db3860c1-6e95-413a-a0f6-462fa2319c3a"}} Aug 24 06:47:13.965841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'server_id': '193f97ea-0a83-4ece-9176-c200ed18a07d', 'body': {'volumeAttachment': {'volumeId': 'db3860c1-6e95-413a-a0f6-462fa2319c3a'}}} Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:13.966723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:13.968141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 400 to user: Invalid volume: volume db3860c1-6e95-413a-a0f6-462fa2319c3a is already attached to instances: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0c541847-bb0b-4fd5-a7f8-121c41465304 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111011 Aug 24 06:47:13.969617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 228/504] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:47:13 2022] POST /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:47:13.975971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:13.976574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:13.982951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.983480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.983917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:13.984672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:13.985097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:13.985522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.010473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:14.089753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4e265406-103c-42e9-8355-afd388668dea tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 204 len: 0 microversion: 2.1 time: 0.118027 Aug 24 06:47:14.090569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 277/505] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:47:13 2022] DELETE /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:47:14.100674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:14.100674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:14.106443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.106927 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.107386 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.108076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:14.108559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:14.108986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:14.247002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:14.255579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0bed9e2f-662b-4051-87c1-b737b19551b4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1683 microversion: 2.1 time: 0.159897 Aug 24 06:47:14.256148 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 229/506] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:14 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:15.282794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:15.283533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:15.290563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.291056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.291547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.292224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:15.292684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:15.293113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:15.427664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:15.436433 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-114e7a56-d4be-4970-b83f-1d9feb301287 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1683 microversion: 2.1 time: 0.161001 Aug 24 06:47:15.437187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 278/507] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:15 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:16.458527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:16.459122 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:16.466064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.466546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.466977 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.467709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:16.468161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:16.468580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:16.961278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:16.969657 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9dc3e64c-9218-40d6-8890-db06eb29eb91 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 200 len: 1683 microversion: 2.1 time: 0.515075 Aug 24 06:47:16.970143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 230/508] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:16 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 1683 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:17.392254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "193f97ea-0a83-4ece-9176-c200ed18a07d", "name": "network-vif-deleted", "tag": "7f6226b0-8d94-4788-b98d-169d64e666d4"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:17.405128 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:17.405754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:17.406993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:17.422947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] Creating event network-vif-deleted:7f6226b0-8d94-4788-b98d-169d64e666d4 for instance 193f97ea-0a83-4ece-9176-c200ed18a07d on hv-cinder-85427 Aug 24 06:47:17.429863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-9ce2fdde-b946-479a-b22d-31bc0e779873 req-21b7e36e-be54-4b45-8c6f-c3ed7f0a756e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041218 Aug 24 06:47:17.430611 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 279/509] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:17.992540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:17.994040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:18.006605 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.007102 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.007579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.008300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.008759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.009190 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.028836 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d HTTP/1.1 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:47:18.030471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:47:18.032107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '193f97ea-0a83-4ece-9176-c200ed18a07d'} Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:18.032958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:47:18.034250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:18.035523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:18.035523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6e99ef90-47a0-4eb6-a219-4b126998d72a tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 404 len: 111 microversion: 2.1 time: 0.043734 Aug 24 06:47:18.035523 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 231/510] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:17 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:47:18.042168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-08f072ac-3144-49a9-8947-3f322b18266d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '.version_select at 0x7f3dc87e2f70>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:18.065117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-08f072ac-3144-49a9-8947-3f322b18266d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130154578" status: 202 len: 0 microversion: 2.1 time: 0.027165 Aug 24 06:47:18.065951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 280/511] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:47:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130154578 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:18.789816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:18.790319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:18.797259 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.797742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.798179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.799075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.800290 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.800920 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.884110 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lazy-loading 'services' on Instance uuid 6eddb672-d1fa-40ab-8cae-6e148b2e01ab {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:18.959760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-654f5ab7-d459-46d7-860f-5b22632a8f23 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments/db3860c1-6e95-413a-a0f6-462fa2319c3a" status: 202 len: 0 microversion: 2.1 time: 0.173677 Aug 24 06:47:18.960486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 232/512] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:47:18 2022] DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments/db3860c1-6e95-413a-a0f6-462fa2319c3a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:18.969495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:18.972598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:18.979896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.980344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.980778 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:18.981547 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:18.982199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:18.982623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:19.013951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ce451194-8ccd-4d25-9827-254eff10bf74 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Aug 24 06:47:19.014436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 281/513] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:18 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:20.027936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.030390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.037553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.038045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.038486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.039210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.039683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.040113 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.072462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-74991c07-227a-49eb-ad58-3b45c7ee7206 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049217 Aug 24 06:47:20.073038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 233/514] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:47:20.141047 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.141669 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.148764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.149247 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.149688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.150377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.150856 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.151285 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.177543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:20.265890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-812c4ed6-de79-4269-af6e-80cbdef1e338 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 204 len: 0 microversion: 2.1 time: 0.128428 Aug 24 06:47:20.270753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 282/515] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:47:20 2022] DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:47:20.274979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:20.276187 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:20.285748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.286242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.286677 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.291360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:20.291360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:20.291360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:20.424976 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:20.433085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8aa59de1-490e-4f42-9626-90841ed28025 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1684 microversion: 2.1 time: 0.161989 Aug 24 06:47:20.433691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 234/516] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:20 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:21.456533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:21.457899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:21.464815 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.465295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.465727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:21.466435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:21.466893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:21.467349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:21.614390 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:21.622309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f8980ec3-f222-4e5a-8fa0-f0a4b50bf1ed tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1684 microversion: 2.1 time: 0.170330 Aug 24 06:47:21.622886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 283/517] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:21 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:22.643373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:22.644567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:22.650957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.651678 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.652211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.653315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:22.653982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:22.654586 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:22.813255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:22.821651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d1b665df-3ef1-49a6-a616-78ba08ec83f3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 200 len: 1684 microversion: 2.1 time: 0.181999 Aug 24 06:47:22.834806 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 235/518] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:22 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 1684 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:23.122667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eddb672-d1fa-40ab-8cae-6e148b2e01ab", "name": "network-vif-deleted", "tag": "6325096c-829d-49a5-ab4d-26363e83141d"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:23.138449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.139253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.139685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.153496 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] Creating event network-vif-deleted:6325096c-829d-49a5-ab4d-26363e83141d for instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab on hv-cinder-85427 Aug 24 06:47:23.159410 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-89f0d254-de2a-4157-84ab-158072f7877b req-366e5871-37f5-49b1-9597-de6501986773 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041068 Aug 24 06:47:23.160083 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 284/519] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:23.843972 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.845505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:23.853997 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.854582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.855104 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.856617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:23.857219 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:23.857886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:23.872702 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab HTTP/1.1 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:47:23.874561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:47:23.876277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '6eddb672-d1fa-40ab-8cae-6e148b2e01ab'} Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:23.877222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:47:23.878713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:23.882469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:23.884305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6a07ef90-b073-41fc-adda-ce10726c04e1 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 404 len: 111 microversion: 2.1 time: 0.044445 Aug 24 06:47:23.885652 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 236/520] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:23 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:47:23.894836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-77c4e3fd-8549-4c4a-a83c-44cb011473dd tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '.version_select at 0x7f3dc87bc820>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:23.917793 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-77c4e3fd-8549-4c4a-a83c-44cb011473dd tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306290246" status: 202 len: 0 microversion: 2.1 time: 0.027393 Aug 24 06:47:23.919028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 285/521] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1306290246 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:25.044588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8267f6ea-9cdb-41c1-81a9-1b2bddfc0ef2 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: .version_select at 0x7f3dc868c040>, body: {"keypair": {"name": "tempest-keypair-1076164297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHlvK1yBqWfBN/qc40E3nO02MAoHbCoTL82sVx5vXN2vQQ+WFo5/OyG6+jFKUr8FWTtkFxHIPLmEjXECpP7y67DDwvPnGQSAjdTPbhKtyggF9WyyAecc9twuSzj3diNkw=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:25.062148 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-8267f6ea-9cdb-41c1-81a9-1b2bddfc0ef2 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:25.067068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-8267f6ea-9cdb-41c1-81a9-1b2bddfc0ef2 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:25.091538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8267f6ea-9cdb-41c1-81a9-1b2bddfc0ef2 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050776 Aug 24 06:47:25.092136 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 237/522] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:47:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:26.389801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2031459219", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d764327-7285-4015-bbe3-ebfc93ab6200"}], "security_groups": [{"name": "tempest-securitygroup--1231733075"}], "key_name": "tempest-keypair-1076164297", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:26.509188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] validate_networks() for [('4d764327-7285-4015-bbe3-ebfc93ab6200', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:47:26.943944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:47:26.944576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:47:26.945259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:47:26.945727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:47:26.946312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:47:26.959398 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.959890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.960323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.961048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:26.961503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:26.961931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:26.980052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:26.984623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:26.997195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:47:26.999659 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:47:27.051983 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cf64ead2-e9a5-4c7c-854e-72076164e8a9 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666875 Aug 24 06:47:27.052557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 286/523] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:47:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:47:27.065034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-cffe2d6b-7e90-41e3-a923-d90feba5514e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:27.065821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-cffe2d6b-7e90-41e3-a923-d90feba5514e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:27.124030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-cffe2d6b-7e90-41e3-a923-d90feba5514e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:27.132380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-cffe2d6b-7e90-41e3-a923-d90feba5514e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1242 microversion: 2.1 time: 0.072557 Aug 24 06:47:27.133029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 238/524] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:27 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:28.158738 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:28.159629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:28.168995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.169477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.169912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.170592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:28.171598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:28.171598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:28.242002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:28.250099 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4becbc04-0fb2-4839-a21a-6c865301a662 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1294 microversion: 2.1 time: 0.098876 Aug 24 06:47:28.250675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 287/525] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:28 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:29.271633 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:29.272257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:29.279348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.279838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.280278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.280985 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.281442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.281871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.349967 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:29.358326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b49df747-319f-4b2f-80ea-dea61878025c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1294 microversion: 2.1 time: 0.090654 Aug 24 06:47:29.358887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 239/526] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:29 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:29.536148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:29.537134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:29.545568 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.546061 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.546501 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.547310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:29.547774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:29.548206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:29.672923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lazy-loading 'services' on Instance uuid dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:29.792555 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-17a2ccdf-727d-426e-84be-bc896049dabe tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments/9fa06eb2-8248-4e69-a865-363e604e1eca" status: 202 len: 0 microversion: 2.1 time: 0.262921 Aug 24 06:47:29.793111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 288/527] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:47:29 2022] DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments/9fa06eb2-8248-4e69-a865-363e604e1eca => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:30.387909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:30.388642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:30.395956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.396620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.397317 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.398179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:30.398939 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:30.399569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:30.473114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:30.482291 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a8be2179-296b-43eb-80ca-cde62e21b29e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1302 microversion: 2.1 time: 0.099168 Aug 24 06:47:30.482784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 240/528] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:30 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1302 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:31.504527 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:31.505124 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:31.511870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.512361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.512796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.513501 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:31.513960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:31.514388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:31.648472 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:31.658911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ab778eef-2e83-4178-a9cc-37ba4250bcb3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.159418 Aug 24 06:47:31.659865 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 289/529] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:31 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:32.683048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:32.683776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:32.690955 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.691479 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.691918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.692621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:32.693079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:32.693510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:32.848321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:32.857020 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-46062e7f-813a-433e-acb8-7c261f8af1df tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.180266 Aug 24 06:47:32.857721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 241/530] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:32 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:33.389331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85df03-cf90-4dcd-baf3-0c874eb58be3", "tag": "b40d8ec1-28a2-419c-a4fc-26a7a6312045"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:33.399613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.401186 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.401653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.412634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] Creating event network-changed:b40d8ec1-28a2-419c-a4fc-26a7a6312045 for instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 on hv-cinder-85427 Aug 24 06:47:33.417680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-1b16e325-bf0a-4fb3-8191-493b56334bcb req-4d1057a4-b600-447c-a057-d0e9aa0e977c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Aug 24 06:47:33.418271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 290/531] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:33.708772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:33.712425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:33.719843 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.720333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.720771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.721469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.721923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.722345 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.878695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:33.879519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:33.886917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.887538 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.888057 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:33.888810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:33.889341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:33.889810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.048215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:34.053179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e9e74394-9eb9-4f25-8367-4eadd3f638bd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351245 Aug 24 06:47:34.054036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 242/532] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:47:33 2022] POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:34.066892 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0fdb1c09-74fb-42ef-bddd-a5ef6ed25c47 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.192269 Aug 24 06:47:34.067520 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 291/533] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:33 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:34.299704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:34.308527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.309112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.309616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.333903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Going to try to stop instance {{(pid=127290) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:47:34.388976 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2f281044-dbb0-42bb-919f-b7877c5c4700 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action" status: 202 len: 0 microversion: 2.1 time: 0.094867 Aug 24 06:47:34.389656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 243/534] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:47:34 2022] POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:34.399785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:34.401944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:34.408844 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.409586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.410023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.410740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:34.411432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:34.412072 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:34.547175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:34.555388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-00a45a60-1415-4d39-a1a2-1f05f36c22b4 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.161365 Aug 24 06:47:34.555967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 292/535] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:34 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:35.092588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:35.093394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:35.101224 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.101789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.102305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.103111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.104257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.104765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.254574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.258889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:35.264875 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8e466d86-4202-4dc9-b74e-6f3f1eaa0138 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.179403 Aug 24 06:47:35.265481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 244/536] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:35 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:35.581129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:35.582103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:35.593212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.594027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.594760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.595994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:35.596765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:35.597882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:35.618800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:35.751361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:35.759687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-941b3fa9-93d5-4810-8782-89848a6eef71 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.185047 Aug 24 06:47:35.760374 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 293/537] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:35 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:36.289966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:36.291179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:36.300271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.300792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.301231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.301957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.302389 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.303002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.447403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:36.455445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ccaba59c-393c-4ddb-837a-2be1e8dfc58d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.171984 Aug 24 06:47:36.456026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 245/538] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:36 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:36.790528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:36.791594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:36.802952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.803827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.804564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.805740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.806574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.807307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.948495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:36.960497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3774bd77-8d8b-42b9-b075-0d0cdcc88af0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.176214 Aug 24 06:47:36.961282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 294/539] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:36 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:37.476291 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:37.476931 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:37.478783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:37.486638 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.487431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.487870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.488940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.489661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.490090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.629591 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.637892 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6a6c86a7-219d-44cf-83b0-ae052792d670 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.165492 Aug 24 06:47:37.638510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 246/540] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:37 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:37.982460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:37.983169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:37.985104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:37.985801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:37.994454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.994454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.994454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.994454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.994836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.994836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.127687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.135956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-28bc1f52-7c26-4383-b817-120b4221fbde tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.157720 Aug 24 06:47:38.136549 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 295/541] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:37 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:38.662914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:38.663914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:38.672149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.672634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.673073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.673859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.674320 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.674740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.820356 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.828841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-72f02bed-edda-49f8-b93e-3967cdabf816 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.172528 Aug 24 06:47:38.829417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 247/542] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:38 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:39.157316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:39.157981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:39.165499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.165957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.166483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.167158 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.168046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.168394 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.317136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:39.325494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-416d74ba-b448-472f-a015-f16c4ea0b40d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.172111 Aug 24 06:47:39.326071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 296/543] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:39 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:39.854303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:39.855490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:39.866329 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.867133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.867925 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.869074 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.869833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.870593 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.013054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:40.021282 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a1687dff-8415-401c-952c-a3028533e80f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.173666 Aug 24 06:47:40.021830 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 248/544] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:39 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:40.346524 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:40.348003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:40.354329 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.355088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.356187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.358181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.358659 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.359090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.511608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:40.519709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5a5bfa4b-acfb-4996-9c01-eade55aafadd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.177648 Aug 24 06:47:40.520291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 297/545] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:40 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:41.042341 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.043035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.050048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.050533 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.051232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.052016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.057417 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.057801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.061221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.061674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.064629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.065308 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.065750 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.066493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.066952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.067497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.112648 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d478c98b-2b3e-42c6-9b5d-cc8fdfe5fd66 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments/2f469211-a2aa-484c-8277-8a050041941d" status: 200 len: 194 microversion: 2.20 time: 0.059247 Aug 24 06:47:41.113276 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 298/546] 10.222.0.52 () {60 vars in 1454 bytes} [Wed Aug 24 06:47:41 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments/2f469211-a2aa-484c-8277-8a050041941d => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:41.119620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85df03-cf90-4dcd-baf3-0c874eb58be3", "name": "network-vif-plugged", "status": "completed", "tag": "b40d8ec1-28a2-419c-a4fc-26a7a6312045"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:41.132243 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.132951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.133580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.146600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] Creating event network-vif-plugged:b40d8ec1-28a2-419c-a4fc-26a7a6312045 for instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 on hv-cinder-85427 Aug 24 06:47:41.154495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-29d83b4d-d6ab-4243-be41-4e4ba5289d72 req-5e2b1dd6-980c-4894-bfea-d73162222861 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039277 Aug 24 06:47:41.155214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 299/547] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:41.200035 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.200630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.207943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.208632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.209079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.209805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.210267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.210699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.217288 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:41.226326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a3f7a569-ab8a-4654-bed6-dee2f8d817ad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.187967 Aug 24 06:47:41.226899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 249/548] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:41 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:41.302722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lazy-loading 'services' on Instance uuid 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:41.380074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7680b158-83e7-4cfa-a3c4-674afba6590b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments/2f469211-a2aa-484c-8277-8a050041941d" status: 202 len: 0 microversion: 2.20 time: 0.185053 Aug 24 06:47:41.380812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 300/549] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 24 06:47:41 2022] DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments/2f469211-a2aa-484c-8277-8a050041941d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:47:41.389848 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.392169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.399618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.400220 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.400766 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.401560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.402128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.402665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.436137 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ebec8ef0-37fe-47c6-bdda-77ec72b4e6c9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050441 Aug 24 06:47:41.436729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 250/550] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:41 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:41.541816 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:41.543292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:41.551833 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.552415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.552914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.553736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:41.554259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:41.554709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:41.690376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:41.698916 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ee852f5a-0b88-4732-bf54-7c1a7ae2e656 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.161289 Aug 24 06:47:41.699587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 301/551] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:41 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:42.249296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:42.249911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:42.256868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.257367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.257801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.258499 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.258958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.259435 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.399832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:42.408301 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f7cd1f71-ec85-4483-94ed-ddeea83e5a36 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1368 microversion: 2.1 time: 0.163359 Aug 24 06:47:42.408916 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 251/552] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:42 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:42.450851 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:42.453156 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:42.460931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.461513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.462092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.463097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.463732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.464459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.499563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-501e65ec-269a-479e-8561-dbd60eeda36e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054528 Aug 24 06:47:42.500121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 302/553] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:42 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:42.722863 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:42.723510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:42.729745 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.730556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.730694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.731388 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:42.731848 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:42.732268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:42.869903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:42.880390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bc30cb17-0552-45c6-b6ba-c489fe57ee38 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.161068 Aug 24 06:47:42.881857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 252/554] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:42 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:43.430874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.431529 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.439493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.439988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.440424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.441137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.441599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.442054 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.512414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.514886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.522092 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.522563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.523015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.523808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.524238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.524665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.566638 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-469304e2-8a8b-4517-9c1f-4547157abe93 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058889 Aug 24 06:47:43.567244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 253/555] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:47:43.592552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:43.600571 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1ee0e5ca-51d5-4e8b-8e97-0d578b048cad tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1558 microversion: 2.1 time: 0.174160 Aug 24 06:47:43.601084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 303/556] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:43.621288 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.621788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.627837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.628343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.628773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.629464 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.629914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.630337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.723555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5b004a76-ca11-4fcd-9778-9bcad405cad6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106320 Aug 24 06:47:43.724374 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 254/557] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:43.904401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:43.904909 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:43.906888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:43.912522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.913008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.913440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:43.914134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:43.914588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:43.915006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.418494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:44.429234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ac4781fc-9782-419b-824c-a863b9e4096d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.529236 Aug 24 06:47:44.429816 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 304/558] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:43 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:44.580701 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:44.583040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:44.585010 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:44.590866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:44.592356 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:44.592796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.593502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:44.593956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:44.594379 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.625558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-750ec33d-f53b-41ce-b95a-d70ea10dcfaf tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049583 Aug 24 06:47:44.626131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 255/559] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:44 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:47:44.922588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:44.924900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:44.931429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:44.931905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:44.932331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.933121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:44.933565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:44.933982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:44.956918 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'flavor' on Instance uuid a08ab309-2677-4dcc-9a44-55b9133ef05a {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:45.019828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d85df03-cf90-4dcd-baf3-0c874eb58be3", "tag": "b40d8ec1-28a2-419c-a4fc-26a7a6312045"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:45.029385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.029855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.030291 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.043450 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] Creating event network-changed:b40d8ec1-28a2-419c-a4fc-26a7a6312045 for instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 on hv-cinder-85427 Aug 24 06:47:45.049026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-9ac49cae-ede4-44c6-a27a-5c79d00a6817 req-d4e42c6a-6b75-4cff-9322-9cce5a020fad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033040 Aug 24 06:47:45.052741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 256/560] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:45.097200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4d815ae7-951c-480e-b06e-f2c2227ad328 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/action" status: 200 len: 32 microversion: 2.1 time: 0.178687 Aug 24 06:47:45.098184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 305/561] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:47:44 2022] POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/action => generated 32 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:47:45.110647 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:45.112064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:45.122613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.123318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.123884 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.124810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.125833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.126277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.421530 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:45.431972 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2c75ebc7-8e73-4035-bc13-4efbc6166310 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.327735 Aug 24 06:47:45.446375 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 257/562] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:45 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:45.455415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:45.456601 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:45.466217 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.469368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.470097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.471670 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.472445 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.473774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.638578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:45.641590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:45.648553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.649310 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.649895 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.650788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.651610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.652524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.689372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-152fb898-0dbf-4f17-b084-58fbf2f9b183 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055136 Aug 24 06:47:45.691169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 258/563] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:47:45 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:45.717110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:45.727796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7cfe1177-1c6b-439c-ab59-59c7c96952c5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.277475 Aug 24 06:47:45.741798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 306/564] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:45 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:45.789505 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:45.790360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:45.798001 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.798936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.799491 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.800420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.801078 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.801627 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.829988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:45.916768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6d4437f0-6bb1-4e9e-8704-d32521d02b85 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 204 len: 0 microversion: 2.20 time: 0.129835 Aug 24 06:47:45.918469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 259/565] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 06:47:45 2022] DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:47:45.926665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:45.927323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:45.936874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.937693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.938274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:45.939158 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:45.939640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:45.940199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:46.089886 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:46.098745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:46.100260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:46.101423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e753252d-9dcf-4cb7-a18f-fa28e0529d87 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.178867 Aug 24 06:47:46.101986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 307/566] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:45 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:46.465085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:46.465681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:46.472480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:46.473002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:46.473425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:46.474124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:46.474580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:46.475008 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:46.607339 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:46.611582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:46.617673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5da0e9cc-1c9f-4c6b-9561-05288a128932 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.157657 Aug 24 06:47:46.618264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 260/567] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:46 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:46.750699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:46.751373 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:46.758183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:46.758653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:46.759098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:46.759834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:46.760306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:46.760741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:46.764818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:46.904149 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:46.916861 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-29ae9f63-8356-41ad-9480-fb825bccb2d7 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1677 microversion: 2.1 time: 0.170305 Aug 24 06:47:46.917620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 308/568] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:46 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:47.126333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:47.126983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:47.135119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.135692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.136341 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:47.136862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.137316 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.138029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:47.279643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:47.288607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:47.290118 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:47.291293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-df965794-a640-4414-a48a-9f654ed6a25b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1722 microversion: 2.20 time: 0.169864 Aug 24 06:47:47.291879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 261/569] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:47 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:47.640774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:47.641381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:47.648299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.648800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.649337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:47.650042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.650508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.650936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:47.882846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:47.891596 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4b4d5f95-f8ad-4d30-b1d2-caaad035ba3e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.254874 Aug 24 06:47:47.892171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 309/570] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:47 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:47.938665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:47.939314 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:47.945745 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.946238 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.946679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:47.947438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:47.947901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:47.948718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.168065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:48.176135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-19243de7-a74c-470f-b823-6db687edff19 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1654 microversion: 2.1 time: 0.241917 Aug 24 06:47:48.176871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 262/571] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:47 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1654 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:48.199768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:48.205990 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.206462 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.206921 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.272126 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Going to try to start instance {{(pid=127291) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:47:48.316663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:48.317716 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:48.318455 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5893f541-a45f-4d91-a849-6b90fe2c4917 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action" status: 202 len: 0 microversion: 2.1 time: 0.122836 Aug 24 06:47:48.322617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 310/572] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:47:48 2022] POST /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:47:48.329017 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.330302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.330862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.331719 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.332279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.333035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.337865 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:48.338607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:48.347014 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.347804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.348239 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.349110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.350426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.351123 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.490529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:48.500042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:48.501540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:48.502970 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b5e60c4a-afe1-40e2-8757-02658a9aafd0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 200 len: 1654 microversion: 2.20 time: 0.191976 Aug 24 06:47:48.503555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 263/573] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:48 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 1654 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:48.589945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:48.597806 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ca250915-40af-47cc-a9f7-73c2dabe1a59 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1663 microversion: 2.1 time: 0.265273 Aug 24 06:47:48.598748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 311/574] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:48 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1663 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:48.743494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b", "name": "network-vif-deleted", "tag": "089197a3-4eb5-4520-9e9f-cbb2ae723ccc"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:48.755161 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.755776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.756325 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.774164 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] Creating event network-vif-deleted:089197a3-4eb5-4520-9e9f-cbb2ae723ccc for instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b on hv-cinder-85427 Aug 24 06:47:48.792618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-e7e95bf1-ee23-4af3-82d1-0eb31625ed74 req-48cfc2de-fc79-407e-a48e-147b5c93154d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045628 Aug 24 06:47:48.801543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 264/575] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:48.914671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:48.915289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:48.922207 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.922779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.923299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:48.924393 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:48.924852 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:48.925287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:49.066786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:49.075803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e8041497-e70b-479a-a09b-277138c0b4ed tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.165624 Aug 24 06:47:49.076376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 312/576] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:48 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:49.527457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:49.528594 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:49.534816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:49.535475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:49.535993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:49.536835 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:49.537402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:49.537906 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:49.551695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b HTTP/1.1 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:47:49.553362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:47:49.555168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b'} Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:49.556042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:47:49.557297 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:47:49.558573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:49.558573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4301ef49-d42c-4523-8538-18b3e30c63c6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 404 len: 111 microversion: 2.20 time: 0.032285 Aug 24 06:47:49.558573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 265/577] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:49 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:47:49.564267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-80b270e9-c9c7-4926-b6c5-497d5175eb23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '.version_select at 0x7f3dc879b5e0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:49.586056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-80b270e9-c9c7-4926-b6c5-497d5175eb23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-992223648" status: 204 len: 0 microversion: 2.20 time: 0.025818 Aug 24 06:47:49.586634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 313/578] 10.222.0.52 () {60 vars in 1259 bytes} [Wed Aug 24 06:47:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-992223648 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:47:49.619359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:49.620057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:49.627547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:49.628047 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:49.628683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:49.629574 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:49.630035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:49.630705 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:49.786576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:49.799418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-05bbf8a0-1ca0-456e-9851-4435f9c09a09 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1663 microversion: 2.1 time: 0.183906 Aug 24 06:47:49.800002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 266/579] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:49 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1663 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:50.097798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:50.098798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:50.107372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:50.107892 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:50.108504 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:50.109229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:50.109689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:50.110113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:50.263238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:50.271637 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f3578242-b708-445f-b038-c95c8fc1fc92 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.178491 Aug 24 06:47:50.272213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 314/580] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:50 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:50.507665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4cfa6e96-38f9-46ab-b43d-cbc3baeeb23a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: .version_select at 0x7f3dc86a7c10>, body: {"keypair": {"name": "tempest-keypair-2058508282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwJR/GoGKCuzBxoyeqz0I/IPEmNIQdAOwHo4kUiRQSqIDUChh8SG3/ux76E+Z4gwCHcoHjskq99YCNoxmF2xUSKI4n1CDy9rDjDf/Tqk8MD48ujPJWRFSsXz3e6dkk5Vg=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:50.524674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-4cfa6e96-38f9-46ab-b43d-cbc3baeeb23a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:50.529001 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-4cfa6e96-38f9-46ab-b43d-cbc3baeeb23a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for user bfb5dc1fa16f465ba1ebca000b665d46 and project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:50.554491 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4cfa6e96-38f9-46ab-b43d-cbc3baeeb23a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050704 Aug 24 06:47:50.555115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 267/581] 10.222.0.52 () {62 vars in 1200 bytes} [Wed Aug 24 06:47:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 06:47:50.824190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:50.824812 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:50.830771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:50.831296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:50.831734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:50.832621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:50.833102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:50.833512 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:50.976035 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:50.984649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9f7ab266-d8e1-4682-8d37-d7ed504381aa tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1667 microversion: 2.1 time: 0.165851 Aug 24 06:47:50.985228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 315/582] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:50 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:51.293266 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:51.293888 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:51.300162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:51.300658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:51.301099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:51.301858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:51.302321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:51.302779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:51.440555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:51.449949 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-db74f795-c916-4aa2-b146-d8d4514d5623 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.160710 Aug 24 06:47:51.450529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 268/583] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:51 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:51.897587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-353655403", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be3c841-0d59-4803-979e-08c48130dbdb"}], "security_groups": [{"name": "tempest-securitygroup--2130030265"}], "key_name": "tempest-keypair-2058508282", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:52.009862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] validate_networks() for [('8be3c841-0d59-4803-979e-08c48130dbdb', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:47:52.399993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:47:52.400616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:47:52.401465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:47:52.402150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:47:52.402761 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:47:52.417146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:52.417632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:52.418072 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:52.418809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:52.419287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:52.419749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:52.437139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:47:52.441077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Getting quotas for user bfb5dc1fa16f465ba1ebca000b665d46 and project 0aec98515a95467aa9a43853bfdcb7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:47:52.452001 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:47:52.454309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:47:52.471892 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:52.472456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:52.479486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:52.479974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:52.480415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:52.481115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:52.481565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:52.481991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:52.517614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-47a2c6f1-d590-4dd7-9926-898af2aa3fe8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624383 Aug 24 06:47:52.518302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 316/584] 10.222.0.52 () {62 vars in 1188 bytes} [Wed Aug 24 06:47:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 06:47:52.532591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:52.533429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:52.601896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:52.611393 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:52.612963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:52.614217 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-10445e3c-a478-46ed-9190-7d757d2d7a2d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1281 microversion: 2.20 time: 0.088745 Aug 24 06:47:52.614610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 317/585] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:52 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:52.665702 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:52.674974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2a43bbe9-7b29-4056-9a5c-492c1cf91d90 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.207074 Aug 24 06:47:52.675659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 269/586] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:52 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:53.636732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:53.637710 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:53.644780 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:53.645255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:53.645891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:53.646632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:53.647292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:53.647704 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:53.697787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:53.698855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:53.706359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:53.707093 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:53.707571 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:53.709026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:53.709738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:53.710362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:53.718916 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:53.728092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:53.729589 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:53.731179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fe026667-f217-4d01-9f5e-284ae9bcb9e8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1339 microversion: 2.20 time: 0.098602 Aug 24 06:47:53.731782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 318/587] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:53 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:54.096416 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:54.105509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0e0e249a-ff43-4d43-83f9-330e6f5308d5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.411712 Aug 24 06:47:54.106184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 270/588] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:53 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:54.757406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:54.758050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:54.765321 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:54.765811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:54.766250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:54.766954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:54.767449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:54.767878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:54.882821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:54.898650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:54.900050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:54.900676 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:54.907951 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:54.917890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:54.919443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:54.920638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b557c968-cb4f-4c01-9e45-8aa42ac4b1e1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.167293 Aug 24 06:47:54.921241 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 319/589] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:54 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:54.937172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] Creating event network-changed:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:47:54.942761 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-0e84815d-49e2-4ca3-988a-5aa210099e06 req-ef1294ea-3362-4ebf-9ec2-5d7342628a9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066110 Aug 24 06:47:54.943384 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 271/590] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:55.128802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:55.129689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:55.138699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:55.139245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:55.139695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:55.140406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:55.140870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:55.141302 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:55.282495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:55.292808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d1bf1595-a115-4358-865f-0e7c7ca866cd tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.169632 Aug 24 06:47:55.293419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 320/591] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:55 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:55.948420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:55.949747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:55.956905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:55.957388 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:55.957855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:55.958554 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:55.959013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:55.959477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.090635 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:56.098930 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:56.100478 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:56.101583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e8f36642-c51d-45d3-94a6-726a3c0b3c4f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.160652 Aug 24 06:47:56.102153 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 272/592] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:55 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:56.314627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:56.315175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:56.322045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.322573 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.323033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.323772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:56.324238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:56.324796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:56.472707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:56.485481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5fddcc37-cfc1-4c4b-8c14-c45b86540265 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.175144 Aug 24 06:47:56.486297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 321/593] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:56 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:57.125289 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:57.125860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:57.134499 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:57.135240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:57.135901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:57.136974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:57.137656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:57.138315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:57.277350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:57.286203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:57.287738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:57.289046 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ad5304b6-fac1-40ca-a8ad-a63e3132ccf8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.168583 Aug 24 06:47:57.289611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 273/594] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:57 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:57.508178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:57.509832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:57.518063 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:57.518556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:57.518993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:57.519734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:57.520193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:57.520599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:57.656906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:57.665488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9d6b8a94-9fc4-4df0-9f52-d345ccec4b61 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.161241 Aug 24 06:47:57.666067 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 322/595] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:57 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:58.321740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:58.322590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:58.330519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.331008 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.331486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.332186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.332644 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.333068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.473631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:58.482202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:58.483733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:58.484847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-737ceaf1-1197-4719-a1ef-575557126dac tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.168802 Aug 24 06:47:58.485412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 274/596] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:58 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:58.687774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:58.688417 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:58.695353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.695837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.696283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.696988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:58.697450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:58.697881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:58.835799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:58.844528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fe593200-a0a4-4510-8e98-d6dd4edf6c0d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.161221 Aug 24 06:47:58.845085 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 323/597] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:58 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:59.213014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "name": "network-vif-plugged", "status": "completed", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:59.224279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.224844 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.225273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.236961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] Creating event network-vif-plugged:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:47:59.241742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-c65fd2a1-9fb0-4356-bcf9-ec79652f13f4 req-f2284ee4-b28b-4d64-8b93-35e668f93875 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Aug 24 06:47:59.242330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 275/598] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:59.511398 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:59.512270 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:59.520498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.521030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.521419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.522140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.522597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.523009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.663040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:59.671891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:59.673444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:59.674561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-83d92de3-a1d3-4b29-8072-4fcb97b611d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.169397 Aug 24 06:47:59.675103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 324/599] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:59 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:47:59.868579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:59.869308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:59.878600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.879087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.879568 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:59.880300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:59.880764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:59.881192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.023034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:00.031705 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-34750ff5-4695-4dac-af70-4fdd525cf912 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1736 microversion: 2.1 time: 0.169117 Aug 24 06:48:00.032282 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 276/600] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:59 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:00.707745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:00.708361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:00.715164 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:00.715673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:00.716106 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.716798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:00.717246 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:00.717664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:00.863081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:00.875730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:00.877788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:00.878907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8eccad68-26dc-4a10-9c0d-2fb7185d4d7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1407 microversion: 2.20 time: 0.176443 Aug 24 06:48:00.879508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 325/601] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:00 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:48:01.057460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.058456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.061995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:01.071822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.072646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.073382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.074547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.075362 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.076125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.213036 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:01.222211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fe465964-6de8-47fe-abe7-3636a99c8fe4 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1716 microversion: 2.1 time: 0.171378 Aug 24 06:48:01.222779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 277/602] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:01 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1716 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:01.351748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.352376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.361148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.361655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.362157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.363110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.363828 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.364312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.386194 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:01.457798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] HTTP exception thrown: Cannot 'detach_volume' instance a08ab309-2677-4dcc-9a44-55b9133ef05a while it is in vm_state rescued Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Request method failure captured: Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments/4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3 HTTP/1.1 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciMQYxqjFL4J9c0ZNOclwwwII2pfCT0ojww9qU3GEWvw2d1CAhFiZ4d43cu0uE7JMqYjokRA0unRqyMAewphhEmMwX61Q0JjEFYuqnQSphqrmxPe9dbO721l1_LZFCY1Pzh1K6v1fC7uVnkaDAUT5HAk9QUUDvStQeLFhREoCMx1tM Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:48:01.459752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a401374685240dc94fe28ca99ad4e11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 2c917c21c7974c8d9746e8b05d9c8b9f Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:48:01.461416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Cannot 'detach_volume' instance a08ab309-2677-4dcc-9a44-55b9133ef05a while it is in vm_state rescued Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'server_id': 'a08ab309-2677-4dcc-9a44-55b9133ef05a', 'id': '4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3'} Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:01.462253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a08ab309-2677-4dcc-9a44-55b9133ef05a while it is in vm_state rescued Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a08ab309-2677-4dcc-9a44-55b9133ef05a while it is in vm_state rescued Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:01.464911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Returning 409 to user: Cannot 'detach_volume' instance a08ab309-2677-4dcc-9a44-55b9133ef05a while it is in vm_state rescued {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:01.466078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-74d94a28-ea13-431f-bca7-a0f310cb2de1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments/4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3" status: 409 len: 152 microversion: 2.1 time: 0.116133 Aug 24 06:48:01.466078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 326/603] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:48:01 2022] DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments/4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3 => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 06:48:01.470558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:01.471732 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.478534 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.479025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.479496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.480195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.480650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.481419 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.551964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e30d81b4-bc29-40d8-8484-022f03b7e775 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/action" status: 202 len: 0 microversion: 2.1 time: 0.085239 Aug 24 06:48:01.552614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 278/604] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:48:01 2022] POST /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:01.561126 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.561727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.568376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.568858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.569295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.570012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.570467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.570887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.712818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:01.722428 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-833fa024-6772-4ff1-943c-bb8af529755f tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1724 microversion: 2.1 time: 0.165492 Aug 24 06:48:01.723015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 327/605] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:01 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:01.911070 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:01.911798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:01.919792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.920552 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.921019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:01.921837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:01.922350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:01.922825 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:02.065953 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:02.074794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:02.076318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:02.077468 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8030e344-2d12-4b9b-ad1d-9b74c2cda7ce tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1598 microversion: 2.20 time: 0.172281 Aug 24 06:48:02.078056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 279/606] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:01 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:48:02.100610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:02.101109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:02.107228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:02.107767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:02.108205 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:02.108902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:02.109355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:02.109779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:02.190640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5e1e82c2-fcbb-4b23-a131-0dc6000100d1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094534 Aug 24 06:48:02.191538 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 328/607] 10.222.0.52 () {60 vars in 1316 bytes} [Wed Aug 24 06:48:02 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:48:02.744871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:02.745507 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:02.752953 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:02.753685 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:02.754129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:02.754831 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:02.755319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:02.755794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:02.760027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:02.981519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:02.990264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-00e1d980-a3fa-47b5-96a4-45a65c25699c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1724 microversion: 2.1 time: 0.249403 Aug 24 06:48:02.990865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 280/608] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:02 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:03.252785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:03.253614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=8 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:03.258164 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:03.269212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:03.269704 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:03.270137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:03.283778 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] Creating event network-changed:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:48:03.289309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-8bf18563-0aeb-4ee8-8c1e-c0117893279e req-464b84a3-87a6-4380-9114-9c8670b1c86a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037182 Aug 24 06:48:03.289930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 329/609] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:04.013991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:04.014601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:04.022518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:04.022987 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:04.023460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:04.024185 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:04.024642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:04.025070 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:04.174715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:04.183583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1e60cbbc-3b8e-4828-b926-2917443a7d3c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1724 microversion: 2.1 time: 0.174242 Aug 24 06:48:04.184171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 281/610] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:04 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:05.210342 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:05.211301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:05.220005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.221830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.222271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.222992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.223493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.223932 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.382660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:05.396733 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bdce0482-2b86-4e3a-934f-ccb15148eab0 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1730 microversion: 2.1 time: 0.193963 Aug 24 06:48:05.397590 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 330/611] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:05 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:05.422006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:05.422550 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:05.429944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.430425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.430856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.431573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:05.432023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:05.432446 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:05.512898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-75dfc038-2bee-4226-9421-fea4dd6df277 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094857 Aug 24 06:48:05.513717 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 282/612] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:48:05 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:06.414684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:06.428109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:06.428730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:06.429384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:06.442095 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] Creating event network-changed:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:48:06.447467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-2bf66e4d-c4d9-4c75-8430-60ad4980d01b req-8b74db59-ecf1-40d3-ab39-f99ba361b390 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037726 Aug 24 06:48:06.448443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 331/613] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:08.466110 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:08.478781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:08.479265 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:08.479837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:08.492907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] Creating event network-changed:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:48:08.498227 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-ec5573ee-f884-4d96-84a8-3e790de5f209 req-68aba87a-04cd-412e-a711-fb6ac5d79d9b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037452 Aug 24 06:48:08.498810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 283/614] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:28.920651 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:28.921372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=22 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:29.117892 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.118491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.124946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.125434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.125872 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.126563 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.127020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.127483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.150912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a047c0b5-291b-421a-8800-fe6ee6602431 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/ips" status: 200 len: 150 microversion: 2.1 time: 0.237653 Aug 24 06:48:29.151491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 332/615] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:48:28 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/ips => generated 150 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:29.595711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:29.596689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=16 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:29.603993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.607111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.618117 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.619008 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.619612 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.620114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.620568 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.620988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.651723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-19fb9cd4-fac1-4c37-8421-a430e9ffd807 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058601 Aug 24 06:48:29.652274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 284/616] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:29 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:48:29.716466 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.716964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.723377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.723906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.724337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.725029 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.725481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.725904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.754180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:29.835104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-53aec40a-08db-4efa-923b-ac866d0d75c6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 204 len: 0 microversion: 2.1 time: 0.122496 Aug 24 06:48:29.835800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 333/617] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:29 2022] DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:29.844879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:29.845494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:29.851668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.852158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.852597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:29.853291 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:29.853820 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:29.854246 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:30.096990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:30.105680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c8fe474f-2a68-4bc8-a03b-594cee15fcb0 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1673 microversion: 2.1 time: 0.264699 Aug 24 06:48:30.106260 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 285/618] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:29 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1673 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:30.520882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14356f52-14bf-4f56-8f8a-22ddef01c53c"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:30.524629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:30.535146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:30.535898 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:30.536569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:30.537416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:30.537999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:30.538622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:31.131318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:31.132394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:31.140614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:31.141140 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:31.141585 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:31.142299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:31.142765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:31.143214 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:31.282642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:31.290865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e96f0046-199a-4d34-b2f5-138e3aca4162 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1673 microversion: 2.1 time: 0.166134 Aug 24 06:48:31.291528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 286/619] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:31 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:31.937632 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:48:31.937887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 06:48:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:48:31.989791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-03b2fc7a-d420-4ae9-bde6-2bfe138b70a0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.475973 Aug 24 06:48:31.990491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 334/620] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:48:30 2022] POST /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments => generated 194 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:32.312915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:32.313524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:32.320910 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:32.321408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:32.321847 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:32.322561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:32.323024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:32.323510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:32.456804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:32.465395 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e83dbf6a-82f1-4c15-904e-a5bc914696e1 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 200 len: 1673 microversion: 2.1 time: 0.156628 Aug 24 06:48:32.466016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 287/621] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:32 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:33.041198 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dab5d31b-1a4a-4ca9-999c-f8b06b7660f6", "name": "network-vif-deleted", "tag": "454b34ae-8fe5-46de-9bae-481f3ada5897"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:33.054074 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:33.054907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:33.056857 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:33.068570 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] Creating event network-vif-deleted:454b34ae-8fe5-46de-9bae-481f3ada5897 for instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 on hv-cinder-85427 Aug 24 06:48:33.075878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-a7ca8a60-26b0-4e0f-84df-d6c421d25630 req-9518ad8e-5659-48db-9c59-f7702ec11678 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039124 Aug 24 06:48:33.076859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 335/622] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:33.619751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:33.620484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:33.626827 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:33.627324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:33.627754 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:33.628463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:33.628906 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:33.629324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:33.644072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 HTTP/1.1 Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:48:33.645736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:48:33.647430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'dab5d31b-1a4a-4ca9-999c-f8b06b7660f6'} Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:33.648354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:48:33.649809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:48:33.651477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:33.651477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-929edd5b-1b02-481b-90ba-b4965b116f3a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 404 len: 111 microversion: 2.1 time: 0.164242 Aug 24 06:48:33.651477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 288/623] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:33 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:48:33.657303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ac1fbde8-2720-4c2d-b8ba-130f3f1a68d8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '.version_select at 0x7f3dc879b280>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:33.678884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ac1fbde8-2720-4c2d-b8ba-130f3f1a68d8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154689060" status: 202 len: 0 microversion: 2.1 time: 0.025868 Aug 24 06:48:33.679595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 336/624] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154689060 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:34.575080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4f0c6d34-b69d-4eb7-aff8-42cb05c8760a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: .version_select at 0x7f3dc86a7040>, body: {"keypair": {"name": "tempest-keypair-211485519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwSC/G3Lyzr9yTqc5MWIdjOh7mQMgYDp00JeXc3gjVJGr9P9oNyywKvyvN2SdfcUlFN3BxdfhpWB2b1OhL4JWlY0qSAUP7uEKaeujkZ6eV4ekzg7EQTfvJHQx1/Qt7rrw=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:34.591932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-4f0c6d34-b69d-4eb7-aff8-42cb05c8760a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:34.596035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-4f0c6d34-b69d-4eb7-aff8-42cb05c8760a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for user 1d26cf886087408097cc2e435a785454 and project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:34.623617 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4f0c6d34-b69d-4eb7-aff8-42cb05c8760a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052427 Aug 24 06:48:34.624212 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 289/625] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:48:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:35.934371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2003895695", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "018b0e35-de97-44eb-a1bf-77de9b3c6286"}], "security_groups": [{"name": "tempest-securitygroup--1418425561"}], "key_name": "tempest-keypair-211485519", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:36.044548 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] validate_networks() for [('018b0e35-de97-44eb-a1bf-77de9b3c6286', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:48:36.479117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:48:36.479592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:48:36.480071 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:48:36.480552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:48:36.480974 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:48:36.490337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:36.490830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:36.491307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:36.492028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:36.492488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:36.492926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:36.510995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:36.515298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Getting quotas for user 1d26cf886087408097cc2e435a785454 and project 5b4541156c1f4efab3a61dd6935638bb. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:36.526728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:48:36.529271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:48:36.577237 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0bb4c7e5-347c-4b10-ad74-4d60f16c5101 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647283 Aug 24 06:48:36.577894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 337/626] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:48:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:48:36.589431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-dd992356-81be-4dbb-be1e-5db21c623183 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:36.590133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-dd992356-81be-4dbb-be1e-5db21c623183 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:36.647303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-dd992356-81be-4dbb-be1e-5db21c623183 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:36.654582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-dd992356-81be-4dbb-be1e-5db21c623183 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1237 microversion: 2.1 time: 0.069700 Aug 24 06:48:36.655338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 290/627] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:36 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:37.677105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:37.677703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:37.684896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.685784 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.686254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.686941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.687445 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.687882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.758299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:37.766554 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e14779b3-a3eb-4353-937d-a446e44fab47 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1289 microversion: 2.1 time: 0.094163 Aug 24 06:48:37.767134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 338/628] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:37 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:38.788392 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:38.789012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:38.796203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:38.796690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:38.797128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:38.797832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:38.798641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:38.799565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:38.867782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:38.876127 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-51ea2645-0273-48b7-a740-acd908613a2e tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1295 microversion: 2.1 time: 0.091680 Aug 24 06:48:38.876699 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 291/629] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:38 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:39.544264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:39.546723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.559456 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.560236 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.561332 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.562980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.563986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.564609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.596629 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lazy-loading 'flavor' on Instance uuid cdb639cc-8b84-4663-b991-2954e9c87fef {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:39.688160 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c7cf9b2c-ae5e-4a79-8f70-5b55b8078fee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "POST /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef/action" status: 202 len: 0 microversion: 2.1 time: 0.149483 Aug 24 06:48:39.689113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 339/630] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:48:39 2022] POST /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:39.697382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:39.697797 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.704783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.706013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.706607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.707550 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.708005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.708584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.786495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0be08fb-d458-4180-a877-e5c294e68d47", "tag": "0fd78e71-54b5-4f97-82d9-7b7cd7843f45"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:39.796973 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.797788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.798449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.815614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] Creating event network-changed:0fd78e71-54b5-4f97-82d9-7b7cd7843f45 for instance b0be08fb-d458-4180-a877-e5c294e68d47 on hv-cinder-85427 Aug 24 06:48:39.820509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-4ade0e43-6819-47eb-b823-56e86aa1c1dc req-c21a3199-f22d-48dd-af0c-dabc34d27f73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 Aug 24 06:48:39.821107 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 340/631] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:39.826973 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14356f52-14bf-4f56-8f8a-22ddef01c53c"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:39.829431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.835770 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.836238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.836667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.837351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.837797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.838212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.883277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:39.892475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c2e74339-20d1-4629-8a1e-90724fa0e01d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.199271 Aug 24 06:48:39.893051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 292/632] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:39 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:39.911484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:39.912095 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:39.918558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.919035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.919658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.920519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:39.921121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:39.921689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.924598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: POST /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments HTTP/1.1 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 74 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:48:39.926353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {"volumeAttachment": {"volumeId": "14356f52-14bf-4f56-8f8a-22ddef01c53c"}} Aug 24 06:48:39.928037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'server_id': '6d85df03-cf90-4dcd-baf3-0c874eb58be3', 'body': {'volumeAttachment': {'volumeId': '14356f52-14bf-4f56-8f8a-22ddef01c53c'}}} Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:39.928945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:39.930351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 400 to user: Invalid volume: volume 14356f52-14bf-4f56-8f8a-22ddef01c53c is already attached to instances: 6d85df03-cf90-4dcd-baf3-0c874eb58be3 {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f32608d5-f56b-4f20-a781-246dd0ac81c6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105633 Aug 24 06:48:39.931823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 341/633] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:48:39 2022] POST /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:48:40.001204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:40.001708 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:40.008664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.009206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.009639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.010330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.010807 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.011497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.063354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:40.072186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-51559eb5-4ae8-4812-90cf-83409c187038 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.164356 Aug 24 06:48:40.073159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 293/634] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:39 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:40.102891 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lazy-loading 'services' on Instance uuid 6d85df03-cf90-4dcd-baf3-0c874eb58be3 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:40.180583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a02e7d51-d73c-4164-8818-f8e90e7b36db tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments/14356f52-14bf-4f56-8f8a-22ddef01c53c" status: 202 len: 0 microversion: 2.1 time: 0.184475 Aug 24 06:48:40.181499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 342/635] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:48:39 2022] DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments/14356f52-14bf-4f56-8f8a-22ddef01c53c => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:40.191576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:40.193841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:40.200771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.201404 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.202197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.202780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.203391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.203902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.238059 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fa508b16-8eab-48d5-b1ae-7c31c9016f99 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050595 Aug 24 06:48:40.239553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 294/636] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:40 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:40.916701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:40.917532 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:40.925425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.925979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.926489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.927350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.927897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.928398 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.076682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:41.084714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-eb6c4e47-0f94-435e-a5c2-a9c1921d99eb tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.173995 Aug 24 06:48:41.085284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 343/637] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:40 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:41.093080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:41.093704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:41.100564 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.101055 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.101495 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.102192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.102651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.103061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.239264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:41.249007 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e7679f43-c4fb-4710-aad2-c9829652a401 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.159988 Aug 24 06:48:41.249636 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 295/638] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:41 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:41.252114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:41.254427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:41.260729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.261288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.261720 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.262526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.262975 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.263437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.293125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e68f4a16-354a-4fae-815d-db640e7cf082 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Aug 24 06:48:41.293659 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 344/639] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:41 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:42.108477 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.109476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.116233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.116725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.117167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.117876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.118471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.118752 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.259836 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:42.269013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3db1f977-a735-4856-a4a7-17bb532505ba tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.166620 Aug 24 06:48:42.269551 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 296/640] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:42.270205 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.271073 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.281229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.282066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.282739 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.283865 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.284589 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.285343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.308496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.311438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.317513 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.318014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.318446 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.319133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.319613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.320031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.349943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-81df662c-9c9d-436d-b936-b44fb890686b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045512 Aug 24 06:48:42.350513 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 297/641] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:48:42.412846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.413303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.419670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.420155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.420469 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:42.420632 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.421287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.421742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.422167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.428509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0ef44dd7-f8b1-46e5-9ce9-4820f92f76ad tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.162663 Aug 24 06:48:42.429076 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 345/642] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:42.447674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:42.533800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a09c5885-0e8c-4f1f-b104-4aad5025988e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 204 len: 0 microversion: 2.1 time: 0.123943 Aug 24 06:48:42.534393 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 298/643] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:42 2022] DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:48:42.543603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.544203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.550473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.550954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.551412 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.552105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.552546 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.552967 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.557124 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:42.697181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:42.706308 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6b3d9d58-e0a1-49fb-901d-f6390db33fdb tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1683 microversion: 2.1 time: 0.167230 Aug 24 06:48:42.706895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 346/644] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:43.297245 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.297937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.305075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.305590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.306034 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.306736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.307240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.307765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.451334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.452178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.455408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:43.459260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.459832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.460341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.461121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.461656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.462180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.470514 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0f34baaa-9838-4e5c-8196-ac4ff2ac9dfd tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.177772 Aug 24 06:48:43.471356 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 299/645] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:43.599636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:43.607814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-389b90b7-85ec-4f70-9f7f-157550545ab5 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.161332 Aug 24 06:48:43.608385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 347/646] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:43.732433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.733087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.741559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.742106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.742674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.744245 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.744350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.744785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.878631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:43.886531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-60d2d650-cbf4-4662-8254-858510599efc tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1683 microversion: 2.1 time: 0.159605 Aug 24 06:48:43.887100 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 300/647] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:44.493355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:44.494099 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:44.505849 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.506342 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.506784 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.507550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.508033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.508449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.628849 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:44.630808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:44.639721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.640399 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.640952 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.641794 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.643080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.643658 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.654813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:44.663401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1d06a418-c259-4048-9699-a95589ffbe4f tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.174323 Aug 24 06:48:44.663999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 348/648] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:44 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:44.666151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:44.791270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:44.800283 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4b0cf877-fbe3-4aa5-b730-8aac8db68772 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.175975 Aug 24 06:48:44.800881 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 301/649] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:44 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:44.909049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:44.909594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:44.917177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.917678 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.918395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:44.919455 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:44.920622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:44.921060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.056080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:45.064562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-04c4b1a1-2f1f-4766-801f-d99be09acd4b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1683 microversion: 2.1 time: 0.160377 Aug 24 06:48:45.065369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 349/650] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:44 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:45.372201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be08fb-d458-4180-a877-e5c294e68d47", "name": "network-vif-plugged", "status": "completed", "tag": "0fd78e71-54b5-4f97-82d9-7b7cd7843f45"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:45.387287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.387816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.388395 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.401143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] Creating event network-vif-plugged:0fd78e71-54b5-4f97-82d9-7b7cd7843f45 for instance b0be08fb-d458-4180-a877-e5c294e68d47 on hv-cinder-85427 Aug 24 06:48:45.406441 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-c99b2342-b3ee-4d03-971f-18c40e5902c8 req-104a0e95-f48b-4b2b-a32d-e2884eefa396 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039079 Aug 24 06:48:45.407603 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 302/651] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:45.419460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d85df03-cf90-4dcd-baf3-0c874eb58be3", "name": "network-vif-deleted", "tag": "b40d8ec1-28a2-419c-a4fc-26a7a6312045"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:45.454182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.454779 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.457726 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.476245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] Creating event network-vif-deleted:b40d8ec1-28a2-419c-a4fc-26a7a6312045 for instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 on hv-cinder-85427 Aug 24 06:48:45.491752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-d6907b2d-c3c2-4819-8c5b-05836254dd3a req-98aee57a-575f-4361-9807-5375280d4848 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069515 Aug 24 06:48:45.492986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 350/652] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:45.686822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:45.687593 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:45.694188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.694465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.694961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.695793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.696176 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.696626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.822509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:45.823348 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:45.830129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.830646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:45.831109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.831692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.832483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:45.833008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:45.833506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:45.839146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-77b35009-800e-4abe-9793-3e65ed2840c2 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.157773 Aug 24 06:48:45.840382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 303/653] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:45 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:45.990382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:45.998691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f93b2b0c-3eef-4f1d-b344-ce3ffbc5406f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.181486 Aug 24 06:48:45.999255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 351/654] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:45 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:46.087490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:46.088117 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:46.094643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.095156 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.095588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.096303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.096783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.097257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.132689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.133188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.133661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.134121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lazy-loading 'fault' on Instance uuid 6d85df03-cf90-4dcd-baf3-0c874eb58be3 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:46.179537 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:46.188656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-53f0fd71-7bd8-49a1-98fb-7130b8ede960 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 200 len: 1332 microversion: 2.1 time: 0.105109 Aug 24 06:48:46.189369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 304/655] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:46 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:46.865329 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:46.865942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:46.868021 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:46.868687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:46.875869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.876377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.876864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:46.877566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:46.878026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:46.878458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.019774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.020415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:47.025029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:47.028904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:47.031144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.031675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.032133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.032841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.033453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.033915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.038094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6db23d73-c165-495b-958b-0bb0ae130c5d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.176745 Aug 24 06:48:47.038854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 352/656] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:46 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:47.183023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:47.192718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b921ad3b-656c-42b7-87ea-39ca2ad3026f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1363 microversion: 2.1 time: 0.176764 Aug 24 06:48:47.193300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 305/657] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:47 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:47.211461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.212223 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:47.218933 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.219553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.220166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.222252 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.222942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.223652 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.241042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 HTTP/1.1 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:48:47.242734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:48:47.244323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '6d85df03-cf90-4dcd-baf3-0c874eb58be3'} Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:47.245231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:48:47.246782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:47.248528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:47.248528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-40c7a9b8-5a65-4a99-b6c4-12256c30594c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 404 len: 111 microversion: 2.1 time: 0.037705 Aug 24 06:48:47.248528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 353/658] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:47 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:48:47.256372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-319c23d5-f19d-41e8-95c3-a73147effec4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '.version_select at 0x7f3dc85cf160>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.282926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-319c23d5-f19d-41e8-95c3-a73147effec4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076164297" status: 202 len: 0 microversion: 2.1 time: 0.033150 Aug 24 06:48:47.283500 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 306/659] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076164297 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:47.720650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.721143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:47.727565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.728051 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.728489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.729187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.729647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.730091 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.823825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'services' on Instance uuid a08ab309-2677-4dcc-9a44-55b9133ef05a {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:47.901649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-329fc06c-74a2-4564-a133-6774e17bd250 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments/4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3" status: 202 len: 0 microversion: 2.1 time: 0.184454 Aug 24 06:48:47.902628 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 354/660] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:48:47 2022] DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments/4c6c2c24-600e-46ab-8ab9-d7f0c8ee3fd3 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:47.918278 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:47.922779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:47.930407 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.930928 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.931082 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9fc97baf-2d9b-4fc2-aff5-3070239613fe tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: .version_select at 0x7f3dc8659700>, body: {"keypair": {"name": "tempest-keypair-1604681102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCr6xqaHoCAnxBqg5nOvF3Um7CADxjuv7TtluJlxtjnteuLcL/3+kNgOny5guX88bKmo/i1HHLdUr3Cc17hSKsdZrVobmg3iIQhpRAVPF4skocaX+Vx6+RYq+TvAgJB5w=="}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:47.931409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.932120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:47.932579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:47.933016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:47.950152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-9fc97baf-2d9b-4fc2-aff5-3070239613fe tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:47.954825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-9fc97baf-2d9b-4fc2-aff5-3070239613fe tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:47.967746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0145ed59-be4b-4102-8557-8498cde38a01 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053757 Aug 24 06:48:47.968355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 307/661] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:47 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:47.986848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9fc97baf-2d9b-4fc2-aff5-3070239613fe tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060346 Aug 24 06:48:47.987657 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 355/662] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:48:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:48:48.060066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:48.061052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:48.068056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.068540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.068984 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.069687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.070190 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.070731 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.217439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:48.218578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:48.227262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.227772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.228213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.228930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.229389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.229992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.241564 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:48.250201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-298d2a40-fb6e-4949-831f-ac4d9c3c6bc6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.194327 Aug 24 06:48:48.251430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 308/663] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:48 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:48.376446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:48.384713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-320b6dc2-dc01-4f43-ba27-8dd025d6ccb9 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1549 microversion: 2.1 time: 0.173919 Aug 24 06:48:48.399723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 356/664] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:48 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:48.405987 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:48.407423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:48.414045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.414522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.414977 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.415695 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.416211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.416668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.505697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0502b51e-8edd-43ce-badd-822b26ab206a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103664 Aug 24 06:48:48.506453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 309/665] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:48:48 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:48.980076 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:48.982477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:48.989595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.990097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.990537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:48.991255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:48.991740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:48.992179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.023009 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7a5cb213-3db0-4016-b6ce-03c74009276e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046908 Aug 24 06:48:49.023607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 357/666] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:48:48 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:48:49.100233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:49.100813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:49.106763 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.107296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.107737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.108449 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.108918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.109342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.134953 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:49.220316 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f9abb4ac-8b82-4c81-9c24-6acc8b5763a6 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 204 len: 0 microversion: 2.1 time: 0.124154 Aug 24 06:48:49.221292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 310/667] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:49 2022] DELETE /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:49.229497 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:49.230149 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:49.237004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.237737 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.238182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.239375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.239963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.240626 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.272815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:49.273520 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:49.280949 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.281657 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.282360 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.286355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.286861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.287466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.432768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:49.441526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bce68e92-ae82-4a1d-a532-3cbb918bb1bf tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1690 microversion: 2.1 time: 0.215878 Aug 24 06:48:49.442357 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 358/668] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:49 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:49.462949 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:49.471930 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-dc34c2e8-9ca1-4e59-a92d-e0a9e51ed099 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.203648 Aug 24 06:48:49.472935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 311/669] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:49 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:49.965866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:49.966373 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:49.973211 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.973711 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.974153 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:49.974879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:49.975377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:49.975806 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.001283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-68014926-e2c3-4969-9609-c6685954f496 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/ips" status: 200 len: 149 microversion: 2.20 time: 0.096132 Aug 24 06:48:50.002215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 359/670] 10.222.0.52 () {60 vars in 1289 bytes} [Wed Aug 24 06:48:49 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:48:50.355545 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2026924894", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d764327-7285-4015-bbe3-ebfc93ab6200"}], "security_groups": [{"name": "tempest-securitygroup--771091788"}], "key_name": "tempest-keypair-1604681102", "user_data": "}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:50.372550 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0be08fb-d458-4180-a877-e5c294e68d47", "tag": "0fd78e71-54b5-4f97-82d9-7b7cd7843f45"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:50.383807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:50.384465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:50.385126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.400005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] Creating event network-changed:0fd78e71-54b5-4f97-82d9-7b7cd7843f45 for instance b0be08fb-d458-4180-a877-e5c294e68d47 on hv-cinder-85427 Aug 24 06:48:50.406590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-8bce1b09-7ee9-403f-9557-e7f2950cdd7a req-d231b275-1bce-4d94-baa1-8bbca4cf3f29 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110144 Aug 24 06:48:50.408086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 312/671] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:50.463506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:50.464140 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:50.471762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:50.472240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:50.473254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.473961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:50.474387 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:50.474815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.489386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] validate_networks() for [('4d764327-7285-4015-bbe3-ebfc93ab6200', None, None, None, None, None)] {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:48:50.715947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:50.724189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6edc7279-750d-4717-8a43-c2ddca415b35 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1690 microversion: 2.1 time: 0.265296 Aug 24 06:48:50.724751 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 313/672] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:50 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1690 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:50.742834 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:50.743483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:50.749812 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:50.750303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:50.750715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.751625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:50.752089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:50.752811 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:50.984669 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:50.993346 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-252e0709-b8a6-428a-93cf-0013f8800cd7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.254351 Aug 24 06:48:50.993947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 314/673] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:50 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:51.072879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:48:51.073387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:48:51.073932 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:48:51.074404 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:48:51.074949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:48:51.084416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.084983 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.085638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.086425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.086966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.087488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.104985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:48:51.107156 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:51.110665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Getting quotas for user f264e354671d4456bb33668fb11d9636 and project a41fb206b09941ac80996a3c9cbaae58. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:48:51.124325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:48:51.127349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:48:51.177442 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-866ec6a7-68cb-48ce-bc2a-38e8e9253e71 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.828120 Aug 24 06:48:51.178363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 360/674] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:48:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:48:51.189821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2e1b0206-f211-4ad6-a458-444a1eac0500 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:51.190685 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2e1b0206-f211-4ad6-a458-444a1eac0500 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:51.249714 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2e1b0206-f211-4ad6-a458-444a1eac0500 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:51.257123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2e1b0206-f211-4ad6-a458-444a1eac0500 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1242 microversion: 2.1 time: 0.072002 Aug 24 06:48:51.258344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 315/675] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:51 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:51.745887 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:51.746534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:51.753715 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.754199 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.754634 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.755351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.755804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.756292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.853424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:51.853965 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:51.860822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.861321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.861764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.862466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:51.862961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:51.863423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:51.889156 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lazy-loading 'flavor' on Instance uuid efc5a50e-c3a4-4635-ad0e-2127db777881 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:51.894000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:51.902135 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e3ca574d-1b83-41e1-99c2-b4af9f4a356a tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1690 microversion: 2.1 time: 0.160306 Aug 24 06:48:51.902709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 361/676] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:51 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:52.015493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:52.016283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:52.023437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.023928 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.024353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.025304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.025764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.026211 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.114107 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a18beb85-9ec9-40f5-a90c-fdfe69d23577 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/action" status: 202 len: 0 microversion: 2.20 time: 0.264388 Aug 24 06:48:52.114756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 316/677] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 06:48:51 2022] POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:52.123422 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:52.124255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:52.132056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.132563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.132983 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.133691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.134279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.134692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.169288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:52.177372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e4712e62-cb5f-4e46-81b0-c1a04c8a09b7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.165837 Aug 24 06:48:52.177949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 362/678] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:52 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:52.277135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:52.278533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:52.279151 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:52.280717 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:52.285991 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.286483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.287115 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.287312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:52.287855 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.288315 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.288748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.288937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:52.290081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b13ae993-65db-4cc0-be1f-37564a013a3f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.170784 Aug 24 06:48:52.290642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 317/679] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:52 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:48:52.350330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:52.358868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-eaf2c3c2-f43c-4e49-98bd-ee8a26297e4f tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1246 microversion: 2.1 time: 0.084202 Aug 24 06:48:52.359493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 363/680] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:52 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:52.927053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:52.928534 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:52.933722 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:52.941092 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.941937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.942606 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:52.943650 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:52.944330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:52.945842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.187921 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.196277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d6f7358b-123d-4421-9aec-9b9925b72171 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1690 microversion: 2.1 time: 0.276916 Aug 24 06:48:53.196860 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 318/681] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:52 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1690 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:53.198920 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:53.199864 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:53.208651 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.209840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.210687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.211772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.212306 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.212957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.316671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:53.317316 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:53.324147 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.324573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.325013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.331152 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.331697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.332091 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.465166 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.473895 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8dca2712-ada0-4ff2-84b6-ca95650f971b tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.278834 Aug 24 06:48:53.474638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 364/682] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:53 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:53.485116 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:53.487845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:53.496341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.496896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.497413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.498175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.498865 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.499594 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.517373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.519014 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:53.529457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.531433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.532810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-abb89092-3a71-46bb-a7a2-b528c6ccbcfc tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.222138 Aug 24 06:48:53.546948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 319/683] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:53 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:48:53.573965 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:53.582598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d255d956-bdd8-4c02-a2bd-6be1235459e0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1300 microversion: 2.1 time: 0.106304 Aug 24 06:48:53.583180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 365/684] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:53 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:53.808391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08ab309-2677-4dcc-9a44-55b9133ef05a", "name": "network-vif-deleted", "tag": "2387098c-848a-4eec-b0d6-bbcdd822e16b"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:53.818599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:53.819052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:53.819510 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:53.831254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] Creating event network-vif-deleted:2387098c-848a-4eec-b0d6-bbcdd822e16b for instance a08ab309-2677-4dcc-9a44-55b9133ef05a on hv-cinder-85427 Aug 24 06:48:53.836318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-68467fa1-2429-4c2e-8ecc-ffbf86b63021 req-255fc1fa-28e0-4a68-a0e0-4df226c5bf89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Aug 24 06:48:53.836917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 320/685] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:54.218067 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:54.220752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:54.227482 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.228384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.228871 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.229649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.230114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.230714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.293619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.306210 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-69dca3c4-f296-4fb5-a29a-ca0b0d278c10 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 200 len: 1623 microversion: 2.1 time: 0.091992 Aug 24 06:48:54.306799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 366/686] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:54 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:54.498672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:54.499546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:54.506244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.506742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.507181 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.507967 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.508431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.508991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.558308 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:54.559229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:54.566869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.567352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.567785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.568484 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.568933 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.569368 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.758280 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.766645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-81ff6399-b5d1-44ce-9f20-3bf6f7c3ee83 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.272729 Aug 24 06:48:54.767631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 321/687] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:54 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:54.772956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:54.773872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:54.780381 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.781170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.781801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.782669 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:54.783583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:54.784402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:54.794105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.806997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.808671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.810215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-dc7ad478-79ca-47a2-8597-42ba42b9ae3a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.256196 Aug 24 06:48:54.811394 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 367/688] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:54 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:48:54.884755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:54.893969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c4cc8d4f-a6b7-4d14-a8de-527f4aacbb87 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1300 microversion: 2.1 time: 0.124924 Aug 24 06:48:54.894903 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 322/689] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:54 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1300 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:55.331521 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:55.335257 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: a08ab309-2677-4dcc-9a44-55b9133ef05a] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:55.351699 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.352792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.353323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.354442 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.355002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.355465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.372454 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] HTTP exception thrown: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Request method failure captured: Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a HTTP/1.1 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciMQYxqjFL4J9c0ZNOclwwwII2pfCT0ojww9qU3GEWvw2d1CAhFiZ4d43cu0uE7JMqYjokRA0unRqyMAewphhEmMwX61Q0JjEFYuqnQSphqrmxPe9dbO721l1_LZFCY1Pzh1K6v1fC7uVnkaDAUT5HAk9QUUDvStQeLFhREoCMx1tM Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:48:55.374788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a401374685240dc94fe28ca99ad4e11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 2c917c21c7974c8d9746e8b05d9c8b9f Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. Aug 24 06:48:55.376203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'a08ab309-2677-4dcc-9a44-55b9133ef05a'} Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:55.380610 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. Aug 24 06:48:55.382048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:48:55.384251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Returning 404 to user: Instance a08ab309-2677-4dcc-9a44-55b9133ef05a could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:55.384251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4ac2b739-c4d0-4d84-8547-72977258962e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a" status: 404 len: 111 microversion: 2.1 time: 0.052566 Aug 24 06:48:55.384251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 368/690] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:55 2022] GET /compute/v2.1/servers/a08ab309-2677-4dcc-9a44-55b9133ef05a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:48:55.385247 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a5c71f29-b831-4406-a09d-731e5fb140d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '.version_select at 0x7f3dc85a68b0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:55.426070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "name": "network-vif-unplugged", "status": "completed", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:55.427709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a5c71f29-b831-4406-a09d-731e5fb140d1 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884645197" status: 202 len: 0 microversion: 2.1 time: 0.046048 Aug 24 06:48:55.428535 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 323/691] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884645197 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:55.449253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.450058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.450867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.472168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] Creating event network-vif-unplugged:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:48:55.485271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-2157a561-7989-46de-a263-ccd653acaeda req-0595022e-0f9e-4f8d-bff2-4f8743f0eba7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063132 Aug 24 06:48:55.486463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 369/692] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:55.789781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:55.790584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:55.797601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.798259 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.798795 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.799664 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.800325 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.800963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.836157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:55.836774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:55.844171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.844837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.845382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:55.846321 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:55.846783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:55.847386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.115608 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.128164 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fb6304f1-d59e-421d-bcfd-d24731acdfb7 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1564 microversion: 2.1 time: 0.342584 Aug 24 06:48:56.129265 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 324/693] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:55 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1564 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:56.135088 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:56.139119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:56.146712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.147567 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.148605 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.149521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.150182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.150804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.161744 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.170165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.172006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.173376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-39175e6d-c0e3-465a-bb39-c9f87d760ce5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.342482 Aug 24 06:48:56.183605 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 370/694] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:55 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:48:56.196077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4a6c65-00a1-497f-8798-d2ee025cab41", "tag": "47896dbf-b786-424c-af7b-a7ebc39518bf"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:56.209318 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.210077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.211109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.230943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] Creating event network-changed:47896dbf-b786-424c-af7b-a7ebc39518bf for instance fb4a6c65-00a1-497f-8798-d2ee025cab41 on hv-cinder-85427 Aug 24 06:48:56.236281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-9647ff4f-279b-4166-a9ea-8a3de37a9b65 req-dab541ba-63d4-4920-9491-8c9ef8fb0440 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051249 Aug 24 06:48:56.236909 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 371/695] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:56.242440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:56.243134 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:56.250164 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.250776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.251288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.251961 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.252418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.252844 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.476675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127291) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:48:56.559664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f9e2b692-5d52-4512-9b9b-8444243c82b6 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "POST /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef/action" status: 202 len: 0 microversion: 2.1 time: 0.320891 Aug 24 06:48:56.566022 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 372/696] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:48:56 2022] POST /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:48:56.572796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:56.573607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:56.580745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.581578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.582189 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.583595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:56.584225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:56.584801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:56.615348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.643614 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-53483140-32ca-4c5d-a0cb-5c00241ddba3 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1367 microversion: 2.1 time: 0.512947 Aug 24 06:48:56.656720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 325/697] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:56 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1367 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:56.787978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:56.796459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b3101895-2610-4b66-83b2-ed4e17039516 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1512 microversion: 2.1 time: 0.228956 Aug 24 06:48:56.812854 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 373/698] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:56 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1512 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:57.201496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:57.202109 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:57.210079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.210776 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.211267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.211938 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.212555 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.212980 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.356850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:57.366456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:57.368227 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:57.369654 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-724c8330-f055-425b-9464-c6889ca089f8 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.172107 Aug 24 06:48:57.370212 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 326/699] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:57 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:48:57.664788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:57.665506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:57.673298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.673818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.674254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.674952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.675439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.675870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.819839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:57.820451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:57.830383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.830880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.831020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:57.832486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.833139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:57.833348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:57.833772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:57.841799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7349ba00-a823-489a-8a2b-7dee001d0743 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1367 microversion: 2.1 time: 0.180776 Aug 24 06:48:57.842432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 374/700] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:57 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:57.998681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:58.011499 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-eab984f5-4b7c-4ede-bfe5-9b1266d46417 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1514 microversion: 2.1 time: 0.191398 Aug 24 06:48:58.012115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 327/701] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:57 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:58.395462 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:58.396066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:58.403674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:58.404278 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:58.404794 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:58.405878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:58.406488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:58.406814 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:58.551874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:58.561222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:58.563168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:58.564392 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fc0a623f-5383-444d-9396-7bb4acff3b36 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.174084 Aug 24 06:48:58.564989 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 375/702] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:58 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:48:58.862315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:58.863162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:58.869816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:58.870343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:58.870792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:58.871538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:58.871971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:58.872415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.021024 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.033471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.034064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:59.039781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-23f4397b-11cd-4926-b50f-8c4942447146 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1367 microversion: 2.1 time: 0.181402 Aug 24 06:48:59.040341 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 328/703] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:58 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:59.041430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.042038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.042678 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.043416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.043874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.044298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.045359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.045917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:59.051932 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.052718 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.053378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.054307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.054826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.055584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.084009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:59.179445 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-33b13543-4ffc-4617-9511-54631933227d tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 204 len: 0 microversion: 2.1 time: 0.137229 Aug 24 06:48:59.180096 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 329/704] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:59 2022] DELETE /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:48:59.192008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.197400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.198108 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:59.200226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cac33992-a3c5-4912-97b8-e34358a9ca94 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.171071 Aug 24 06:48:59.201052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 376/705] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:59.207048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.207807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.208398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.209272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.210006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.210674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.351831 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.360022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-406b83d8-a548-4ba7-aec2-da9ba829172c tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1508 microversion: 2.1 time: 0.175261 Aug 24 06:48:59.360702 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 330/706] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:48:59.468936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4a6c65-00a1-497f-8798-d2ee025cab41", "name": "network-vif-plugged", "status": "completed", "tag": "47896dbf-b786-424c-af7b-a7ebc39518bf"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:59.479692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.480174 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.480607 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.491884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] Creating event network-vif-plugged:47896dbf-b786-424c-af7b-a7ebc39518bf for instance fb4a6c65-00a1-497f-8798-d2ee025cab41 on hv-cinder-85427 Aug 24 06:48:59.496925 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-336b126d-6aa8-495d-8fa1-227d792678e5 req-731fc1e7-c87b-41e9-92f4-033258142473 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088732 Aug 24 06:48:59.497486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 377/707] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:59.591986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:59.592494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:59.599410 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.599891 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.600319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.601005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:59.601455 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:59.601870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:59.750564 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.759099 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.760615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:59.761769 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-772f0da5-8d28-46cf-ac09-50ca897bcf41 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.173863 Aug 24 06:48:59.762331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 331/708] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:48:59 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:00.066719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.067930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:00.079400 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.079904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.080639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.081345 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.081808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.082238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.218804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.222952 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.223615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:00.227378 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d9cd14f4-b7a3-40c4-8517-76dddf81b708 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1367 microversion: 2.1 time: 0.168636 Aug 24 06:49:00.227977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 378/709] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:00.229769 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.230255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.230674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.231453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.231911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.232325 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.369670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.379021 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8a51fad1-a475-4fa5-a9fd-af88f3045454 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.160437 Aug 24 06:49:00.379623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 332/710] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:00.382195 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.382819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:00.389093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.389589 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.390112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.390947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.391450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.391874 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.541716 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.551735 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bf27801a-54b4-460b-9c70-0365ba397ffc tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1508 microversion: 2.1 time: 0.173596 Aug 24 06:49:00.552323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 379/711] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:00.786785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:00.787446 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:00.794039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.794541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.795020 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.795761 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:00.796338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:00.796749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:00.939679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.948829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.950343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:00.951529 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bf3a5444-b6fa-4d0f-9338-5a947d891a51 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.168763 Aug 24 06:49:00.952093 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 333/712] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:00 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:01.248000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:01.248616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:01.251766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:01.252414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=10 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:01.258163 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.258650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.259118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.259847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.260307 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.260734 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.401500 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:01.405280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:01.408964 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:01.413045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:01.416191 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-653ba5b7-a457-4baa-b11c-3d3822f5da57 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1367 microversion: 2.1 time: 0.171602 Aug 24 06:49:01.436002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.436155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.437584 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.439061 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.441909 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 380/713] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:01 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:01.442798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.443395 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.468037 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:01.488316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c37ed41f-655a-4350-8028-3ffb0012a366", "name": "network-vif-deleted", "tag": "3a7756a4-6904-4669-84c1-c44620572080"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:01.520255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.520817 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.521473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.538175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] Creating event network-vif-deleted:3a7756a4-6904-4669-84c1-c44620572080 for instance c37ed41f-655a-4350-8028-3ffb0012a366 on hv-cinder-85427 Aug 24 06:49:01.543458 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-fdb22d36-869c-412b-ae24-ac4b31e67647 req-ea46ad2c-e5fb-46fc-b458-0b20065c923a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058986 Aug 24 06:49:01.544845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 381/714] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:01.573234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:01.573944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:01.584397 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.591818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.592371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.593476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.594361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.594801 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.621065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:01.627858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.628338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.628766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.629211 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'fault' on Instance uuid c37ed41f-655a-4350-8028-3ffb0012a366 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:01.631323 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d255de39-2e7b-40ff-998f-7c0617b4432e tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.233740 Aug 24 06:49:01.631904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 334/715] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:01 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:01.673577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:01.681271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6d245311-280f-4287-affe-b74047a87929 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1312 microversion: 2.1 time: 0.112475 Aug 24 06:49:01.681838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 382/716] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:01 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1312 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:01.975642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:01.976255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:01.982407 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.982897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.983358 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:01.984054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:01.985041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:01.985511 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.124333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.132918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.134460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.135659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3dfc2ca9-1527-4168-951d-b0a957fc18af tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.164062 Aug 24 06:49:02.136232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 335/717] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:01 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:02.441380 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:02.442031 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:02.451598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.452231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.452793 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.454297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.454760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.455226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.596747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.605150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ef752e52-70df-46f5-b007-466436a88aab tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1557 microversion: 2.1 time: 0.170700 Aug 24 06:49:02.605728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 383/718] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:02 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:02.627723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:02.628321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:02.635081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.635606 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.636010 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.636710 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.637155 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.637578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.652347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:02.652968 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:02.659645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.660135 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.660557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.661259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.661721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.662148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.666347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:02.752564 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-313bfffc-eacb-4d5a-8996-4cf3cf1d045d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129734 Aug 24 06:49:02.753163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 336/719] 10.222.0.52 () {58 vars in 1275 bytes} [Wed Aug 24 06:49:02 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:02.757789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:02.758390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:02.764791 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.765253 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.765750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.766689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.767064 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.767764 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.802004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:02.802737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:02.802870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:02.803310 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'fault' on Instance uuid c37ed41f-655a-4350-8028-3ffb0012a366 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:02.834183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.843349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f346ffd7-cbfc-42e2-8ff2-4a5643441a4a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.194782 Aug 24 06:49:02.850224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 384/720] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:02 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:02.855734 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:02.864149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2786ce03-e438-46a6-9f9d-97ef148f0722 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 200 len: 1312 microversion: 2.1 time: 0.110003 Aug 24 06:49:02.864861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 337/721] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:02 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:03.159050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:03.159604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:03.167093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.167701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.168215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.168926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.169382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.169804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.311017 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:03.319980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:03.321591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:03.322768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9729c129-edcb-409b-a20c-4249fa8261d2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.168060 Aug 24 06:49:03.323394 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 385/722] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:03 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:03.713959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4a6c65-00a1-497f-8798-d2ee025cab41", "tag": "47896dbf-b786-424c-af7b-a7ebc39518bf"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:03.724766 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.725334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.725880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.738060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] Creating event network-changed:47896dbf-b786-424c-af7b-a7ebc39518bf for instance fb4a6c65-00a1-497f-8798-d2ee025cab41 on hv-cinder-85427 Aug 24 06:49:03.744744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-8286d606-d1ca-4f65-bd2c-145922128405 req-1db8e5e2-75fd-4a0b-8ef8-9a9131cd5717 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034065 Aug 24 06:49:03.745354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 338/723] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:03.865913 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:03.866766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:03.873583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.874083 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.874528 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.875323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.875827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.876293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.886046 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:03.886755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: c37ed41f-655a-4350-8028-3ffb0012a366] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:03.896737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.897269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.897708 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.898879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.899478 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.899913 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.917729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] HTTP exception thrown: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Request method failure captured: Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 HTTP/1.1 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciMQYxqjFL4J9c0ZNOclwwwII2pfCT0ojww9qU3GEWvw2d1CAhFiZ4d43cu0uE7JMqYjokRA0unRqyMAewphhEmMwX61Q0JjEFYuqnQSphqrmxPe9dbO721l1_LZFCY1Pzh1K6v1fC7uVnkaDAUT5HAk9QUUDvStQeLFhREoCMx1tM Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:49:03.920069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a401374685240dc94fe28ca99ad4e11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 2c917c21c7974c8d9746e8b05d9c8b9f Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. Aug 24 06:49:03.921475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'c37ed41f-655a-4350-8028-3ffb0012a366'} Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:49:03.922755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. Aug 24 06:49:03.924144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:49:03.926826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Returning 404 to user: Instance c37ed41f-655a-4350-8028-3ffb0012a366 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:49:03.927963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f9cec89e-acb1-4785-91bf-53881a44ac47 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366" status: 404 len: 111 microversion: 2.1 time: 0.046154 Aug 24 06:49:03.929088 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 339/724] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:03 2022] GET /compute/v2.1/servers/c37ed41f-655a-4350-8028-3ffb0012a366 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:49:03.948176 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:03.948591 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:03.954933 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.955466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.955904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.956609 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:03.957065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:03.957489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:03.987553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:49:04.052138 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:04.062582 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d4a022cc-5cfb-4442-af99-972bf61d400d tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.200408 Aug 24 06:49:04.063980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 386/725] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:03 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:04.084682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-51ec1047-f3db-42dd-b7e3-91bde1da5eb5 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 204 len: 0 microversion: 2.1 time: 0.145613 Aug 24 06:49:04.085400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 340/726] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:49:03 2022] DELETE /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:49:04.093552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:04.094198 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:04.100162 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:04.100654 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:04.101095 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:04.101790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:04.102250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:04.102680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:04.237964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:04.245758 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0ce9fe88-ae51-45fc-91fa-c0123b9a9344 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.156151 Aug 24 06:49:04.246326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 387/727] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:04 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:04.347222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:04.347937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:04.354659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:04.355184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:04.355659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:04.356376 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:04.356833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:04.357258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:04.502259 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:04.510639 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:04.512163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:04.513319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-38aaa983-1557-4371-83c1-7b2ea4de1ac4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.171134 Aug 24 06:49:04.513876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 341/728] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:04 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:05.089694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:05.090573 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:05.098921 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.099431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.099859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.100552 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.101004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.101422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.235260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:05.243174 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-881ee52d-90e5-444c-8be1-3ab6d58161e9 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.160829 Aug 24 06:49:05.243774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 388/729] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:05 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:05.266671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:05.267408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:05.274097 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.274590 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.275026 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.275755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.276207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.276631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.425620 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:05.437790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-93b29106-6e8c-4abe-a931-c6fd164d2e9e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.175462 Aug 24 06:49:05.438570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 342/730] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:05 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:05.536992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:05.537603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:05.544010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.544498 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.544941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.545666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:05.546127 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:05.546574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:05.679577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:05.688639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:05.690140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:05.691334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2fc5ad52-5ec4-4b92-9861-cea9d73e2ec1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.158390 Aug 24 06:49:05.691894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 389/731] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:05 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:06.264908 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:06.265604 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:06.272578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.273223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.273493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.274196 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.274655 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.275082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.412267 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:06.420308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b837c1fe-e486-47b0-b4d5-708c601b7327 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.159337 Aug 24 06:49:06.420889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 343/732] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:06 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:06.467689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:06.468562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:06.476536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.477139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.477664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.478500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.479049 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.479620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.638263 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:06.647112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-10ea1c6f-0158-427d-acb5-63e53e0c36ac tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1522 microversion: 2.1 time: 0.185732 Aug 24 06:49:06.647718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 390/733] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:06 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:06.718070 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:06.718901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:06.729169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.729821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.730508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.731670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:06.732397 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:06.733098 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:06.883703 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:06.892810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:06.894306 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:06.895509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1cc52fb1-281e-4b7d-992d-07cb0ec51450 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.184342 Aug 24 06:49:06.896080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 344/734] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:06 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:07.442365 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:07.443067 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:07.449395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.449885 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.450323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.451110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.451604 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.452031 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.535918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8a1bf0-8a43-4089-b507-6dba65b29948", "name": "network-vif-deleted", "tag": "c8eba2b0-b09a-4bae-9f7b-feefb9b58a05"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:07.548854 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.549483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.549990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.565752 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] Creating event network-vif-deleted:c8eba2b0-b09a-4bae-9f7b-feefb9b58a05 for instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 on hv-cinder-85427 Aug 24 06:49:07.570855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-ac25d189-1da3-4232-a082-a7cbf7bf0acb req-15adc034-cee5-46d5-8af0-ccfe1bfceecb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038868 Aug 24 06:49:07.571491 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 345/735] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:07.614171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:07.622479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-600edf3d-6ab3-4c81-9814-801226e9a2ee tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.184272 Aug 24 06:49:07.623059 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 391/736] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:07 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:07.668579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:07.669316 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:07.675962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.676427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.676867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.677565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.678014 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.678439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.711177 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.711691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.712132 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.712582 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lazy-loading 'fault' on Instance uuid 8c8a1bf0-8a43-4089-b507-6dba65b29948 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:07.755811 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c917c21c7974c8d9746e8b05d9c8b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a401374685240dc94fe28ca99ad4e11', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:07.763715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9c77be77-c8e6-427c-826d-6b74d8a4537e tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 200 len: 1311 microversion: 2.1 time: 0.099428 Aug 24 06:49:07.764293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 346/737] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:07 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:49:07.927719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:07.928359 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:07.934645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.935128 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.935949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:07.936715 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:07.937241 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:07.938112 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:08.074914 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:08.084489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:08.086260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:08.087541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bab55cf3-06fd-400a-8ecb-d904fd675f05 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.164524 Aug 24 06:49:08.095463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 392/738] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:07 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:08.648518 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:08.649480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:08.658813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:08.659342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:08.659785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:08.660486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:08.660971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:08.661399 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:08.785114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:08.785862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] [instance: 8c8a1bf0-8a43-4089-b507-6dba65b29948] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:08.792943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:08.793804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:08.794457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:08.795451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:08.795977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:08.796489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:08.801711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:08.809508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5fe8c450-315c-4b4d-8fa4-5555b85a8df8 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.167022 Aug 24 06:49:08.810674 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 347/739] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:08 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:08.812146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] HTTP exception thrown: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Request method failure captured: Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 HTTP/1.1 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciMQYxqjFL4J9c0ZNOclwwwII2pfCT0ojww9qU3GEWvw2d1CAhFiZ4d43cu0uE7JMqYjokRA0unRqyMAewphhEmMwX61Q0JjEFYuqnQSphqrmxPe9dbO721l1_LZFCY1Pzh1K6v1fC7uVnkaDAUT5HAk9QUUDvStQeLFhREoCMx1tM Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:49:08.814111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a401374685240dc94fe28ca99ad4e11", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a401374685240dc94fe28ca99ad4e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 2a401374685240dc94fe28ca99ad4e11 Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1315141086 Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 2c917c21c7974c8d9746e8b05d9c8b9f Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1315141086-project Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. Aug 24 06:49:08.815743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '8c8a1bf0-8a43-4089-b507-6dba65b29948'} Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:49:08.820181 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. Aug 24 06:49:08.822154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:49:08.823593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] Returning 404 to user: Instance 8c8a1bf0-8a43-4089-b507-6dba65b29948 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:49:08.823593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bf61a538-dbfb-445f-b3e1-2813b49f60b8 tempest-ServerRescueNegativeTestJSON-1315141086 tempest-ServerRescueNegativeTestJSON-1315141086-project] 10.222.0.52 "GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948" status: 404 len: 111 microversion: 2.1 time: 0.034701 Aug 24 06:49:08.823593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 393/740] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:08 2022] GET /compute/v2.1/servers/8c8a1bf0-8a43-4089-b507-6dba65b29948 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:49:09.112753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:09.113358 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:09.119519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:09.120001 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:09.120427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:09.121084 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:09.121721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:09.122143 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:09.257223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:09.266045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:09.267589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:09.268760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c1eaf1ae-3a42-47c3-b06d-16d9809d85f2 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1742 microversion: 2.20 time: 0.160505 Aug 24 06:49:09.269324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 348/741] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:09 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:09.831628 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:09.832200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:09.838792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:09.839316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:09.839747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:09.840444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:09.840896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:09.841317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:10.000741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:10.010943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f54c2e46-bee4-48f2-9de1-370d951e252c tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.183236 Aug 24 06:49:10.011934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 394/742] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:09 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:10.291207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:10.291871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:10.298886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:10.299421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:10.299865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:10.300585 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:10.301044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:10.301471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:10.441645 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:10.451610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:10.453452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:10.454675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7fd5b67d-ed29-43b1-a022-7d74cebe5d23 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1742 microversion: 2.20 time: 0.167477 Aug 24 06:49:10.455257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 349/743] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:10 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1742 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:11.034475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:11.036250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:11.043453 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:11.044337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:11.044973 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:11.046076 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:11.047002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:11.048598 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:11.292375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:11.303592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2249f3f9-7e21-4b84-b2d5-4e14a6e686db tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.273177 Aug 24 06:49:11.304823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 395/744] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:11 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:11.488459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:11.489945 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:11.497524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:11.498729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:11.499427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:11.501123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:11.501944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:11.502580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:11.820100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "name": "network-vif-plugged", "status": "completed", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:11.846486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:11.847008 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:11.847503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:11.882297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] Creating event network-vif-plugged:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:49:11.904242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-4d13337f-8176-487b-9b60-3e79c29295e9 req-656ed723-2be5-4d99-94d0-c5e2c671e86a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090070 Aug 24 06:49:11.907222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 396/745] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:11.912195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:11.922787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:11.924990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:11.939407 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-90310e29-4571-4d20-b8a4-f7579c9e87e5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.444431 Aug 24 06:49:11.940322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 350/746] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:11 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:12.326714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:12.327587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:12.339245 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:12.342136 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:12.342674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:12.343614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:12.351803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:12.352495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:12.599419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:12.611325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7c128d17-a4b2-488a-883e-c7b5c6bc7777 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.289278 Aug 24 06:49:12.645797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 397/747] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:12 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:12.968336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:12.969130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:12.982202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:12.982734 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:12.983138 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:12.985909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:12.987465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:12.988886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:12.994701 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:13.147184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:13.161619 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:13.163173 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:13.164413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-014bfa0b-571c-4485-a980-026d0edb2ce6 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.202227 Aug 24 06:49:13.172097 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 351/748] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:12 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:13.637915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:13.638569 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:13.654041 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:13.654488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:13.654927 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:13.655665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:13.657651 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:13.658089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:13.869707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:13.884215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9e1a47e8-7ad2-4e24-90b1-f7506b5dbe35 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1570 microversion: 2.1 time: 0.253620 Aug 24 06:49:13.885259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 398/749] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:13 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1570 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:13.924773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "name": "network-vif-plugged", "status": "completed", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:13.934694 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:13.935890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:13.936421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:13.948025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] Creating event network-vif-plugged:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:49:13.954307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-1426c034-301d-4ae5-8d09-d21b77081ba3 req-086f5310-2344-451f-96b3-b07e3667fde1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033578 Aug 24 06:49:13.955262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 352/750] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:14.188351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:14.189261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:14.196762 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.197481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.198092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.199509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.200131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.200868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.394449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:14.404627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:14.407471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:14.410990 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2ee407e0-0635-437f-92b7-279796af415b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.226485 Aug 24 06:49:14.412115 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 399/751] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:14 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:14.905959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:14.906671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:14.918961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.919790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.920231 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:14.920955 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:14.921498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:14.922192 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:15.110689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:15.119133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-84a13da5-e740-407a-b46c-89bc6d4a8540 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1557 microversion: 2.1 time: 0.217988 Aug 24 06:49:15.131264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 353/752] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:14 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:15.439297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:15.441061 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:15.451633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:15.452267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:15.452915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:15.453728 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:15.454250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:15.454995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:15.654023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:15.663593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:15.667289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:15.668539 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-332451e7-2113-4b23-b9b0-624c27314d03 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.234790 Aug 24 06:49:15.669477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 400/753] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:15 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:16.692720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:16.694151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:16.702901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:16.703608 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:16.704205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:16.705074 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:16.705920 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:16.706535 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:16.898269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:16.908530 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:16.911506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:16.919979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a7221492-135c-43d7-9da2-e6c2c88c99f1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.231763 Aug 24 06:49:16.940002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 354/754] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:16 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:17.949966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:17.951440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:17.958190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:17.958944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:17.959733 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:17.960695 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:17.961337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:17.962000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:18.112881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:18.122260 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:18.124005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:18.125664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d112a3e3-266c-4551-98f2-7665f530b0ee tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.179872 Aug 24 06:49:18.131723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 401/755] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:17 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:19.150839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:19.151561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:19.160115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:19.161048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:19.161698 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:19.162692 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:19.163743 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:19.164864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:19.320899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.331624 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.334082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:19.335530 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-134c5a7e-68b6-4bb1-9f94-11b5a68c56cd tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.190492 Aug 24 06:49:19.336294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 355/756] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:19 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:20.359288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:20.359963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:20.371766 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.372775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.373674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.374637 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:20.375389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:20.376044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:20.380661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=100 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:20.541873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.551521 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.553077 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:20.554291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f0fd8db9-557a-4ce0-a47f-925f0eb5be73 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.199167 Aug 24 06:49:20.554881 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 402/757] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:20 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:21.577782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:21.578691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:21.585538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.586031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.586473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:21.587184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:21.587680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:21.588105 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:21.722336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:21.734891 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:21.736412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:21.737643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6e3ccb9f-ab4c-4ed3-a3d1-703c6ca1450c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1737 microversion: 2.20 time: 0.164132 Aug 24 06:49:21.738275 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 356/758] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:21 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:22.761020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:22.761638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:22.764175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:22.770055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:22.770539 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:22.770974 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.771714 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:22.772173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:22.772580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:22.923537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.934350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.936362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:22.937969 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-40f4e79a-7a81-4abd-9385-516766e45bdb tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1719 microversion: 2.20 time: 0.180769 Aug 24 06:49:22.938579 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 403/759] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:22 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:23.962201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:23.962828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:23.965347 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:23.970696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.971211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.971686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:23.972397 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:23.972858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:23.973287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:24.109333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.118499 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.120035 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:24.121194 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5a92ee72-167b-4acb-b9ea-fbb382874a7c tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1719 microversion: 2.20 time: 0.162917 Aug 24 06:49:24.121784 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 357/760] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:23 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:25.146991 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:25.147772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:25.157926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.158517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.159011 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.159947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.160432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.160889 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.304623 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.314114 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.315957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:25.317154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d914e898-e88f-4ccf-a4db-960fe1dd602f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1662 microversion: 2.20 time: 0.176668 Aug 24 06:49:25.331729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 404/761] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:25 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1662 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:25.340649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6334bd21-6fe6-4952-9ff9-48947acccefb"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:25.344900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:25.352342 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.352862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.353298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.354186 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.355133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.355350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.587072 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "name": "network-vif-unplugged", "status": "completed", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:25.601678 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.602235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.602724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.620818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.compute.server_external_events [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] Unable to find a host for instance efc5a50e-c3a4-4635-ad0e-2127db777881. Dropping event network-vif-unplugged {{(pid=127291) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 06:49:25.621986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-a726d14c-5212-490d-b6bf-6bb20af68f77 req-a5a2b459-7d35-4ec0-bfbd-bb1434e3c673 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040042 Aug 24 06:49:25.622802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 405/762] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 06:49:25.685803 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-58bef4c0-2892-458a-8cfc-405dec77fc32 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349217 Aug 24 06:49:25.686540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 358/763] 10.222.0.52 () {62 vars in 1364 bytes} [Wed Aug 24 06:49:25 2022] POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:49:25.817301 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:25.817849 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:25.824180 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.824662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.825080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:25.825763 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:25.826214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:25.826630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.097846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-47dad031-eaf4-4c52-8203-7cc12a802a46 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments/6334bd21-6fe6-4952-9ff9-48947acccefb" status: 202 len: 0 microversion: 2.20 time: 0.284291 Aug 24 06:49:26.102785 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 406/764] 10.222.0.52 () {60 vars in 1457 bytes} [Wed Aug 24 06:49:25 2022] DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments/6334bd21-6fe6-4952-9ff9-48947acccefb => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:49:26.163237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:26.163933 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:26.170030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.170770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.171223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.171921 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.172436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.172861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.202887 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127290) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:49:26.282094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-71af0fc4-11ff-4963-ac95-5f1e99ccb54f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/action" status: 202 len: 0 microversion: 2.20 time: 0.122865 Aug 24 06:49:26.282993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 359/765] 10.222.0.52 () {62 vars in 1319 bytes} [Wed Aug 24 06:49:26 2022] POST /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:49:26.291772 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:26.292395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:26.300299 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.300799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.301240 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.302131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:26.302638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:26.303324 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:26.466956 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:26.475439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:26.476988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:26.478157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-922a7ab8-db73-4f30-af3a-22ac236fd5b7 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1670 microversion: 2.20 time: 0.190382 Aug 24 06:49:26.478720 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 407/766] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:26 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:27.503909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:27.503909 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:27.511207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:27.511829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:27.512395 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:27.513414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:27.514072 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:27.514498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:27.667213 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.676608 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.678243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:27.679563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d0453d77-b4ae-4ab1-832d-67ba1a16e0b9 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.181651 Aug 24 06:49:27.680368 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 360/767] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:27 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:28.706169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:28.708004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:28.716941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:28.717717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:28.718284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:28.719102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:28.719667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:28.720214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:28.865220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.873752 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.875287 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:28.876578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-85396a89-d980-4d4b-86a1-3a9748acb639 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.176474 Aug 24 06:49:28.877143 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 408/768] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:28 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:29.899956 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:29.901008 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:29.907662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.908164 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.908602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:29.909302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:29.909765 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:29.910191 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:30.053704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.062935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.064454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:30.065619 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a7fbaa72-24ee-4fa1-86d6-509f8bfcc3be tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.169762 Aug 24 06:49:30.066226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 361/769] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:29 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:31.090347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:31.091152 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:31.098593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.099089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.099564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.100250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:31.100949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:31.101384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:31.253809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.262303 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.264043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:31.265351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-083c9388-1263-4e6d-b3cc-a13d85a2a2a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.179433 Aug 24 06:49:31.266027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 409/770] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:31 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:32.289233 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:32.290729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:32.298969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.299556 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.299988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.300696 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:32.301147 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:32.301565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:32.442193 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.455043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.456559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:32.457771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a752b213-74d4-460c-93fc-109b91306105 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.172890 Aug 24 06:49:32.458333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 362/771] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:32 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:33.481993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:33.483161 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:33.491117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:33.491736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:33.492178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:33.492915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:33.493557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:33.493984 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:33.632781 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:33.644929 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:33.646740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:33.648330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-658e7fd5-0850-4042-8fb8-3431498c0c97 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.170677 Aug 24 06:49:33.664736 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 410/772] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:33 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:34.090792 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:34.091391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:34.098125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.098615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.099060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.099848 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.100330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.100783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.125135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-599fa193-a5d8-4102-b2c1-9078d18e3220 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/ips" status: 200 len: 146 microversion: 2.1 time: 0.038260 Aug 24 06:49:34.125940 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 363/773] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:49:34 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:34.676678 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:34.677606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:34.687684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.688184 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.688632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.689492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:34.690310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:34.690754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:34.834501 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.842680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.844218 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:34.845386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1e2c8e37-5f93-4878-ac83-a981e4316766 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.176242 Aug 24 06:49:34.845945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 411/774] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:34 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:35.868063 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:35.869483 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:35.881065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.881560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.881993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:35.882704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:35.883156 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:35.883618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:36.024211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.033023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.034755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:36.036025 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-df93d974-fd94-4391-8cf5-7e005f03667a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.172178 Aug 24 06:49:36.036780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 364/775] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:35 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:37.062771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:37.063668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:37.071850 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.072364 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.072837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.073572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.074029 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.074459 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.214484 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.226036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.227587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:37.228751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4832a187-670c-4a02-8943-e722d1f26db4 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.172187 Aug 24 06:49:37.229507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 412/776] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:37 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:37.622704 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aad45141-6339-4199-b129-556d258106f6"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:37.625067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:37.631873 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.632389 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.632822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.633508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:37.633958 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:37.634377 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:37.638277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.263526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:38.264335 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:38.271904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.272185 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.272704 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.273431 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:38.273877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:38.274305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:38.389436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-17267be4-736a-400f-81a1-9ab40e695dc8 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770663 Aug 24 06:49:38.390056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 365/777] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:49:37 2022] POST /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 194 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:38.424627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.434234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.436369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:38.437574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6440abab-67ee-492f-83aa-a162ab22552f tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.178189 Aug 24 06:49:38.438203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 413/778] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:38 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:39.461871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:39.462646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:39.483272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.483927 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.484490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:39.485394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:39.485927 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:39.486433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:39.633665 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:39.641905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:39.643448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:39.644600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-25a42d79-81c9-4475-873d-d9237d09e114 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.187341 Aug 24 06:49:39.645151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 366/779] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:39 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:40.667631 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:40.668240 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:40.675587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:40.676087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:40.676519 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:40.677423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:40.678090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:40.678680 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:40.829783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.838928 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.840583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:40.841810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4606a954-c6d0-467f-b9cf-cd9f7b3aa7d0 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.178063 Aug 24 06:49:40.842542 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 414/780] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:40 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:41.865337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:41.865947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:41.872966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.873475 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.873914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:41.875009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:41.875502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:41.875904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:42.011808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.020300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.021883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:42.023225 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-3d4ef6f3-843a-44c0-bfb7-756d3fd02d31 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.161946 Aug 24 06:49:42.024005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 367/781] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:41 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:43.050495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:43.051500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:43.063372 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.064229 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.064924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.066091 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:43.066837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:43.067638 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:43.208492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.217888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.219421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:43.220538 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f257a457-4109-4d03-899c-7e5e50fce794 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.176775 Aug 24 06:49:43.221188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 415/782] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:43 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:44.245476 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:44.246068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:44.254769 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.255254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.255723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.256494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:44.256986 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:44.257420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:44.418801 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.427565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.429115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:44.430273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1ab65b7b-1321-4b39-9e40-ad29fd63352a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.189669 Aug 24 06:49:44.430840 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 368/783] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:44 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:45.454821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:45.455265 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:45.462919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.463435 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.463861 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.464553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.465005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.465420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.625838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:45.640534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:45.642062 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:45.643250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e116257f-9796-4615-991f-49970e55d35d tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.192482 Aug 24 06:49:45.643847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 416/784] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:45 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:45.831871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "name": "network-vif-plugged", "status": "completed", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:45.843456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:45.843982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:45.844433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:45.857758 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] Creating event network-vif-plugged:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:49:45.863021 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-765305ae-e34e-4f5d-8904-49a612001fad req-33eb85df-46b5-41b9-8f4b-907306268a36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035033 Aug 24 06:49:45.863626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 369/785] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:46.138110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:46.140633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:46.146848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.147425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.147901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.148600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.149089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.149516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.151857 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:46.180334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3c7815d7-54c4-4517-b3a1-8f5b66d38d87 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Aug 24 06:49:46.180884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 417/786] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:46 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:46.194438 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:46.194990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:46.201265 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.201760 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.202208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.202911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.203411 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.203842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.234363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-23354cac-cc41-4cf1-acb4-64b251983137 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6" status: 200 len: 194 microversion: 2.1 time: 0.045283 Aug 24 06:49:46.234962 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 370/787] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 06:49:46 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:49:46.669805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:46.670401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:46.677522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.678052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.678635 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.679656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:46.680170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:46.680586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:46.827388 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.836055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.837567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:46.838742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1f989278-ca90-464a-8b69-4ebd91de8ea5 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.172921 Aug 24 06:49:46.839407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 418/788] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:46 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:47.583125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09e3f09a-02ff-4d30-a755-e004f0687a76"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:47.585618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:47.592882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.593372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.593813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.594509 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.594970 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.595447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.862390 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:47.863107 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:47.872470 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.872987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.873530 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.874119 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:47.876330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:47.877940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:47.907961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1ef46928-2857-47ae-abd6-a9626017f1bd tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "POST /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327990 Aug 24 06:49:47.914019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 371/789] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:49:47 2022] POST /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:48.067170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.076915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.078282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:48.079576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-91cd1f98-284d-42ab-9eae-78b84c5ce4a1 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1728 microversion: 2.20 time: 0.221382 Aug 24 06:49:48.095848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 419/790] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:47 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:49:49.102644 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:49.103363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:49.110876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.111494 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.112022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.112796 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:49.113312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:49.113808 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:49.252334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.261029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.262503 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:49.263684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d456b7ba-2732-4862-90d1-f728c9e84561 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1715 microversion: 2.20 time: 0.165488 Aug 24 06:49:49.264244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 372/791] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:49:49 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:49:50.822645 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1348046612", "imageRef": "c8949fcc-b458-4b63-ad22-61c8cd61a9b5", "flavorRef": "452"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:50.884356 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.network.neutron [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] validate_networks() for None {{(pid=127291) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:49:51.174709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Flavor limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:49:51.175163 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Image limits 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:49:51.175685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Flavor pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:49:51.176097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Image pref 0:0:0 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:49:51.176515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.virt.hardware [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127291) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:49:51.186535 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.187021 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.187492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.188228 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:51.188703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:51.189133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:51.205602 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Getting quotas for project 481a2aeb141e48bb8e94ec53a53b5396. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:49:51.209907 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Getting quotas for user 579a71fafffe46bba09a1e1bbf074d5e and project 481a2aeb141e48bb8e94ec53a53b5396. Resources: {'cores', 'instances', 'ram'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:49:51.221467 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Going to run 1 instances... {{(pid=127291) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:49:51.223839 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c8949fcc-b458-4b63-ad22-61c8cd61a9b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127291) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:49:51.270331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-081099c8-3c9e-4aa0-9420-5762ae2d736e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451395 Aug 24 06:49:51.270902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 420/792] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:49:51.281837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-98e61f14-07dc-4a65-9080-dd7ff016dd02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:51.282420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-98e61f14-07dc-4a65-9080-dd7ff016dd02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:51.338066 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-98e61f14-07dc-4a65-9080-dd7ff016dd02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:51.345195 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-98e61f14-07dc-4a65-9080-dd7ff016dd02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1215 microversion: 2.1 time: 0.067294 Aug 24 06:49:51.345725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 373/793] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:51 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:52.367142 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:52.367840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:52.375385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:52.375900 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:52.376344 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:52.377029 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:52.377494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:52.378135 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:52.444083 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:52.453126 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8879d0b8-70e3-43ec-b4c6-dba9423425cc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1285 microversion: 2.1 time: 0.090771 Aug 24 06:49:52.453721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 421/794] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:52 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:53.474103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:53.474724 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:53.487257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.487759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.488420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.489333 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:53.489817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:53.490589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:53.634336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:53.643226 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-31d0b323-b567-4882-9fc0-988d9d85aa02 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.172895 Aug 24 06:49:53.644272 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 374/795] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:53 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:54.190819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a30f00-58d6-4655-b1e9-aabd6ab97410", "tag": "6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:49:54.196139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:54.202575 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.203053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.203537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.216446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] Creating event network-changed:6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d for instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 on hv-cinder-85427 Aug 24 06:49:54.221510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-4dd18b1e-3ee3-4369-85b9-f0ccdab82e92 req-b39c0bf7-d73b-4f7e-be08-6b22ec52bdd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034917 Aug 24 06:49:54.222079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 422/796] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:54.665052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:54.666332 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:54.669400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:54.675800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.676305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.676746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.677442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:54.678076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:54.678684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:54.831115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:54.838950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-49c40675-a198-4370-8bed-94b833c4f162 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.178127 Aug 24 06:49:54.840063 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 375/797] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:54 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:55.507122 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.509430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.516296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.516778 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.517219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.517922 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.518384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.518828 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.550978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8fff46d9-94c0-4673-89cf-cd951e6d70ab tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048755 Aug 24 06:49:55.551583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 423/798] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:55.699959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.700544 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.707263 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.707788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.708262 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.708971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.709433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.709866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.739431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8f517a31-7cb0-4242-82cd-8f5d18423b0f tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6" status: 200 len: 194 microversion: 2.1 time: 0.043778 Aug 24 06:49:55.740017 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 376/799] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:55.751672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.752172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.758544 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.759030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.759515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.760216 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.760675 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.761172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.846019 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lazy-loading 'services' on Instance uuid b0be08fb-d458-4180-a877-e5c294e68d47 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:55.861883 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:55.862502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:55.868840 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.869396 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.869747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.870856 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:55.871344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:55.871773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:55.928697 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6c4f4c86-529c-4a81-80b3-45f528f3347d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6" status: 202 len: 0 microversion: 2.1 time: 0.181720 Aug 24 06:49:55.929286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 424/800] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:49:55 2022] DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/aad45141-6339-4199-b129-556d258106f6 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:49:56.010220 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:56.022348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4a1b1be1-584c-4c50-95b0-e7d9a09ce46e tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.164057 Aug 24 06:49:56.023027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 377/801] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:55 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:57.044889 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:57.045652 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:57.052340 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:57.052827 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:57.053257 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:57.053988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:57.054452 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:57.054883 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:57.196073 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:57.204446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-78c76d66-7447-4dff-b253-ab33544c3a5a tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.164652 Aug 24 06:49:57.205023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 425/802] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:57 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:58.109452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:58.110018 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:58.116528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.117013 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.117447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.118131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.118581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.119001 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.147844 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a14a8e5a-e807-4f83-a655-9d8c9d17d698 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/09e3f09a-02ff-4d30-a755-e004f0687a76" status: 200 len: 194 microversion: 2.1 time: 0.042366 Aug 24 06:49:58.148417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 378/803] 10.222.0.52 () {58 vars in 1413 bytes} [Wed Aug 24 06:49:58 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/09e3f09a-02ff-4d30-a755-e004f0687a76 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:58.159674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:58.160234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:58.166902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.167422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.167857 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.168544 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.168992 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.169414 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.225581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:58.226473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:58.232691 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.233573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.233703 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.234311 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.234769 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.235207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.255755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lazy-loading 'services' on Instance uuid b0be08fb-d458-4180-a877-e5c294e68d47 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:49:58.334144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fbafcdfc-aab5-42fc-b48d-c893bcd2bce6 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/09e3f09a-02ff-4d30-a755-e004f0687a76" status: 202 len: 0 microversion: 2.1 time: 0.178614 Aug 24 06:49:58.335054 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 426/804] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:49:58 2022] DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments/09e3f09a-02ff-4d30-a755-e004f0687a76 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:49:58.377682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:58.386651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2c9b763e-348c-4017-877f-33b9d9b3dfcc tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.165239 Aug 24 06:49:58.387485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 379/805] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:58 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:58.795066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:58.796084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:58.804002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.804492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.805650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.806771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:58.807235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:58.807707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:58.835147 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4ca22a98-dfde-4fab-8ec8-b98107575c4c tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/ips" status: 200 len: 150 microversion: 2.1 time: 0.045877 Aug 24 06:49:58.835775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 427/806] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:49:58 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:49:59.409457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.410076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.416615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.417207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.418015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.418759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.419250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.419686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.517890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.520362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.527155 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.527672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.528104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.528796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.529248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.529669 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.560888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-87037b12-4d4f-4d6b-b227-c553375909df tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046946 Aug 24 06:49:59.561824 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 428/807] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:59 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:49:59.574729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:49:59.579348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:59.585580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9de4a340-ff10-4ede-b5fd-0d1bf990e11d tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.181554 Aug 24 06:49:59.586254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 380/808] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:59 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:49:59.676500 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.678691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.684819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.685698 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.686132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.686823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.687363 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.687792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.727667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c9302524-b900-4761-a961-9a074a270882 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054978 Aug 24 06:49:59.728268 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 429/809] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:49:59 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:49:59.794079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.794578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.802361 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.802858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.803366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.804176 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.804625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.805068 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.831777 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:49:59.916027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-549d6f42-6ad6-482d-bb5b-98115b392a34 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 204 len: 0 microversion: 2.1 time: 0.125495 Aug 24 06:49:59.916840 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 381/810] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:49:59 2022] DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:49:59.925558 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:49:59.926432 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:49:59.932938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.933439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.933880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:49:59.934771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:49:59.935622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:49:59.936058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.068544 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:00.076755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1bf55357-a836-4967-8263-2f3c1fd0de0a tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1674 microversion: 2.1 time: 0.155445 Aug 24 06:50:00.077300 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 430/811] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:49:59 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:00.193052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c088e39a-1c44-4a52-9604-10253f6d7ae5"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:00.195607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:00.202008 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.202496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.203563 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.204276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.204738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.205305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.611566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:00.612310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:00.621173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.621847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.622434 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.623408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:00.624022 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:00.625150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:00.765288 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:00.773439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-096e95c4-9d94-43cf-b479-9505fa7044c6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.167845 Aug 24 06:50:00.774015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 431/812] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:00 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:01.100514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:01.101249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:01.108786 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.109354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.109863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.110671 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.111241 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.111745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.202446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.216622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.257264 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:01.269425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2c4be1e4-f2ea-416e-8a9c-c730720730ae tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1674 microversion: 2.1 time: 0.173314 Aug 24 06:50:01.270149 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 432/813] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:01 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:01.342550 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.608181 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e432da96-55eb-4044-a271-0cbd691f3360 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "POST /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.419502 Aug 24 06:50:01.608809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 382/814] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:50:00 2022] POST /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments => generated 194 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:01.794949 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:01.795804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:01.804971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.805474 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.805919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.807566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.808216 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.808813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.951631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a30f00-58d6-4655-b1e9-aabd6ab97410", "name": "network-vif-plugged", "status": "completed", "tag": "6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:01.957426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:01.966565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-14d62649-b6de-4ce9-a657-b64e9467082b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.175987 Aug 24 06:50:01.966673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:01.967130 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:01.967672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:01.979868 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 433/815] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:01 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:01.981344 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] Creating event network-vif-plugged:6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d for instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 on hv-cinder-85427 Aug 24 06:50:01.987991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-f97331a2-6a50-4e06-9b79-cb5f3215bd44 req-7071abe8-a12c-45ce-a38f-8d770412e600 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040205 Aug 24 06:50:01.988836 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 383/816] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:02.290316 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:02.291322 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:02.297441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:02.297931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:02.298460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:02.299541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:02.300037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:02.300555 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:02.303420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:02.436097 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:02.444768 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d5f3f30c-6476-4492-a19f-e9114653f029 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1674 microversion: 2.1 time: 0.158573 Aug 24 06:50:02.445361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 434/817] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:02 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:02.738973 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0be08fb-d458-4180-a877-e5c294e68d47", "name": "network-vif-deleted", "tag": "0fd78e71-54b5-4f97-82d9-7b7cd7843f45"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:02.749232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:02.749725 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:02.750268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:02.761353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] Creating event network-vif-deleted:0fd78e71-54b5-4f97-82d9-7b7cd7843f45 for instance b0be08fb-d458-4180-a877-e5c294e68d47 on hv-cinder-85427 Aug 24 06:50:02.766245 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-ce943d06-e371-40b1-9b08-56ce918c7eea req-8a4c016c-758d-44d1-b81a-fa0128cc34aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Aug 24 06:50:02.766865 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 384/818] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:02.994295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:02.995329 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:03.006663 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.007371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.007884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.009666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.010188 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.010807 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.151415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.161480 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-eac55d22-ab24-4553-b348-08734cc64805 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1315 microversion: 2.1 time: 0.175358 Aug 24 06:50:03.162081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 435/819] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:02 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:03.466872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:03.467782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:03.474859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.475366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.475800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.476465 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.477089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.477322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.509232 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:03.509721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:03.511015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:03.511511 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lazy-loading 'fault' on Instance uuid b0be08fb-d458-4180-a877-e5c294e68d47 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:03.565924 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d26cf886087408097cc2e435a785454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b4541156c1f4efab3a61dd6935638bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:03.577654 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-65b7156c-3a3f-430f-9a9a-8732251c60ac tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 200 len: 1327 microversion: 2.1 time: 0.114796 Aug 24 06:50:03.578902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 385/820] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:03 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:04.183271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.183948 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.191810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.192292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.192723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.193411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.193860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.194281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.327572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.336032 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8693ee31-42de-4ee2-bfcc-eadcaa971be2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1465 microversion: 2.1 time: 0.157084 Aug 24 06:50:04.336608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 436/821] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:04 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:04.385702 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.386260 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.393277 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.393767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.394207 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.394905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.395412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.395850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.422040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:50:04.514643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9b216f7e-b78b-4787-bcc0-d2dabf2ed7b6 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 204 len: 0 microversion: 2.1 time: 0.132314 Aug 24 06:50:04.515766 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 386/822] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:04 2022] DELETE /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:04.524503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.525244 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.531499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.531988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.532424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.533326 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.533577 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.534016 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.602125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.602919 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:04.609292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.609785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.610228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.611307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:04.611839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:04.612249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:04.628493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 HTTP/1.1 Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:04.630167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:04.631746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'b0be08fb-d458-4180-a877-e5c294e68d47'} Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:04.632527 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:04.633861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:04.635038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:04.635038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-811ef153-19aa-44d9-b944-894573355e5b tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 404 len: 111 microversion: 2.1 time: 0.034038 Aug 24 06:50:04.635038 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 387/823] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:04 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:04.641089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6ae7dad1-0698-421c-b704-4bacb5a9418d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '.version_select at 0x7f3dc8543790>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:04.662041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6ae7dad1-0698-421c-b704-4bacb5a9418d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211485519" status: 202 len: 0 microversion: 2.1 time: 0.024670 Aug 24 06:50:04.662621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 388/824] 10.222.0.52 () {58 vars in 1218 bytes} [Wed Aug 24 06:50:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211485519 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:50:04.674572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:04.682475 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-194a7d82-707f-4fc8-a971-f10e074c3255 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1471 microversion: 2.1 time: 0.161954 Aug 24 06:50:04.683046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 437/825] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:04 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:05.703886 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:05.704508 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:05.712824 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.713311 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.713742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:05.714459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:05.714925 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:05.715394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:05.857121 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:05.866440 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-142e8d75-6706-4895-86fa-e8a779d7a1d2 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1471 microversion: 2.1 time: 0.166528 Aug 24 06:50:05.867005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 389/826] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:05 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:06.429111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a30f00-58d6-4655-b1e9-aabd6ab97410", "name": "network-vif-deleted", "tag": "6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:06.461465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.462172 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.462877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.478617 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] Creating event network-vif-deleted:6cb6b0c9-58fd-4cc6-b161-1abb85c5ba0d for instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 on hv-cinder-85427 Aug 24 06:50:06.483941 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-9da2c559-826a-4b4d-990f-660ee88a221c req-f0a187cc-1d20-40aa-8cff-b92d91ed7ae0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058453 Aug 24 06:50:06.485304 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 438/827] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:06.888586 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:06.889357 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:06.897600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.898119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.898558 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.899500 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.899963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.900392 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.936712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:06.937287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:06.937726 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:06.938174 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lazy-loading 'fault' on Instance uuid b2a30f00-58d6-4655-b1e9-aabd6ab97410 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:06.980611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '579a71fafffe46bba09a1e1bbf074d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481a2aeb141e48bb8e94ec53a53b5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:06.988538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-50d172bb-ecbb-44ea-b643-98dc07bfd20b tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 200 len: 1305 microversion: 2.1 time: 0.104425 Aug 24 06:50:06.989179 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 390/828] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:06 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:07.641439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:07.642037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:07.648571 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.649055 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.649493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.650157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.650625 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.651053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.666297 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 HTTP/1.1 Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:07.668044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.669585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'b0be08fb-d458-4180-a877-e5c294e68d47'} Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:07.670409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.671689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.673231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:07.673231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a22115ae-434d-448a-b463-703d74e5a663 tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 404 len: 111 microversion: 2.1 time: 0.032716 Aug 24 06:50:07.673231 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 439/829] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:07 2022] DELETE /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:07.678750 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:07.679412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: b0be08fb-d458-4180-a877-e5c294e68d47] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:07.685888 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.686432 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.686874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.687600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:07.688022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:07.688721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:07.865880 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 HTTP/1.1 Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:07.867326 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.868874 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'b0be08fb-d458-4180-a877-e5c294e68d47'} Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:07.870004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. Aug 24 06:50:07.872472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:07.874466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance b0be08fb-d458-4180-a877-e5c294e68d47 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:07.874466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-17b1af30-0946-46aa-b963-7fd384c342ba tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47" status: 404 len: 111 microversion: 2.1 time: 0.194561 Aug 24 06:50:07.874466 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 391/830] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:07 2022] GET /compute/v2.1/servers/b0be08fb-d458-4180-a877-e5c294e68d47 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:08.010797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:08.011514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] [instance: b2a30f00-58d6-4655-b1e9-aabd6ab97410] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:08.018840 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.021457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.021964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.022953 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.023633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.024177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.040668 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] HTTP exception thrown: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Request method failure captured: Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 HTTP/1.1 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcoNbIzp9P0P51SybzebSsNqQV-BUSh5h4E71JiF-rh2Nq-bYtCmJpsimCyjsZUmeizG1BAUizQ7aMxYqcs7JWmhJkYruU6txvhC-SHZSleWVDDbq9ITAyJVjV1yGtcT1eL0tNJV_fV2LQa_qkik8khTCzi0LjwwPmddKDHQr75iGYQ Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 481a2aeb141e48bb8e94ec53a53b5396 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesNegativeTest-2061962073 Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:08.042488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/481a2aeb141e48bb8e94ec53a53b5396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_481a2aeb141e48bb8e94ec53a53b5396", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/481a2aeb141e48bb8e94ec53a53b5396"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/481a2aeb141e48bb8e94ec53a53b5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesNegativeTest-2061962073 Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 481a2aeb141e48bb8e94ec53a53b5396 Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesNegativeTest-2061962073 Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesNegativeTest-2061962073-project Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 579a71fafffe46bba09a1e1bbf074d5e Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesNegativeTest-2061962073-project Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. Aug 24 06:50:08.043996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'b2a30f00-58d6-4655-b1e9-aabd6ab97410'} Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:08.044958 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. Aug 24 06:50:08.047377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:08.048682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] Returning 404 to user: Instance b2a30f00-58d6-4655-b1e9-aabd6ab97410 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:08.048682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ad46b1ba-919a-419f-acd5-e3cd4df00fd5 tempest-VolumesNegativeTest-2061962073 tempest-VolumesNegativeTest-2061962073-project] 10.222.0.52 "GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410" status: 404 len: 111 microversion: 2.1 time: 0.038270 Aug 24 06:50:08.048682 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 440/831] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:08 2022] GET /compute/v2.1/servers/b2a30f00-58d6-4655-b1e9-aabd6ab97410 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:08.257826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:08.258420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:08.265006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.265496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.265931 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.266618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.267069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.267561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.350454 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lazy-loading 'services' on Instance uuid fb4a6c65-00a1-497f-8798-d2ee025cab41 {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:08.435528 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9ccd96b7-3cc1-486f-8f64-3aa3cbaf7446 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments/c088e39a-1c44-4a52-9604-10253f6d7ae5" status: 202 len: 0 microversion: 2.1 time: 0.180853 Aug 24 06:50:08.436678 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 392/832] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:50:08 2022] DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments/c088e39a-1c44-4a52-9604-10253f6d7ae5 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:50:08.450845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:08.454457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:08.466214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.467343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.468407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.469818 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:08.470936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:08.472025 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:08.515665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-121fbd60-6e52-4625-95d2-f8c772b3271b tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072567 Aug 24 06:50:08.519313 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 441/833] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:08 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:09.030249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.030841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.039597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.040366 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.041350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.042106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.042577 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.043543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.057605 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 HTTP/1.1 Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:09.059405 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.061367 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'dab5d31b-1a4a-4ca9-999c-f8b06b7660f6'} Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:09.062300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.064463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.065994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:09.065994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-669a13e2-dd43-4f93-b397-935df17269bc tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 404 len: 111 microversion: 2.1 time: 0.035288 Aug 24 06:50:09.065994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 393/834] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:09 2022] DELETE /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:09.074858 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.075536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] [instance: dab5d31b-1a4a-4ca9-999c-f8b06b7660f6] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.082449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.082952 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.083506 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.084123 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.084647 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.085484 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.105117 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] HTTP exception thrown: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Request method failure captured: Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 HTTP/1.1 Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciRjn6di7B4zIUsHNFc8elIYMAi4QRqLx184V5ULbVjUR_FBvUVBr2NwHpYdR6AV8f69R5jVb6yI8_KibACwaqv3SvuDc-L1fUSM2s31JDI0XLJNhwfgMMGEPRvDQRyVD4jvGnNvrwP128gmiMkFqhNTJ3GwDYhfyLSd8oGL2Q966M Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:09.106877 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b4541156c1f4efab3a61dd6935638bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b4541156c1f4efab3a61dd6935638bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 5b4541156c1f4efab3a61dd6935638bb Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1415580573 Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 1d26cf886087408097cc2e435a785454 Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeTestJSON-1415580573-project Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.108284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'dab5d31b-1a4a-4ca9-999c-f8b06b7660f6'} Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:09.109275 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. Aug 24 06:50:09.110507 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:09.111718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] Returning 404 to user: Instance dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:09.111718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ef6ec68b-53eb-4f78-8c63-806be00cb43d tempest-AttachVolumeTestJSON-1415580573 tempest-AttachVolumeTestJSON-1415580573-project] 10.222.0.52 "GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6" status: 404 len: 111 microversion: 2.1 time: 0.037730 Aug 24 06:50:09.111718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 442/835] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:09 2022] GET /compute/v2.1/servers/dab5d31b-1a4a-4ca9-999c-f8b06b7660f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:09.528935 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.532120 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.538966 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.539547 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.540205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.541194 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.541768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.542211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.575048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d6404a96-f44f-4ebe-9293-e1519552ca1e tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050292 Aug 24 06:50:09.575643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 394/836] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:50:09 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:50:09.644709 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.645440 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.652013 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.652511 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.652954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.653660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.654118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.654561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.684190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:50:09.790140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-82009540-fd65-4c30-bff9-20ff71a174d0 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 204 len: 0 microversion: 2.1 time: 0.148781 Aug 24 06:50:09.791169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 443/837] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:09 2022] DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:09.800950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:09.801866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:09.808331 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.809053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.809697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.811287 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:09.811822 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:09.812524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:09.959793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:09.962871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:09.967815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a38771bb-f9ad-4970-b639-531e94af382d tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1682 microversion: 2.1 time: 0.171866 Aug 24 06:50:09.968398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 395/838] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:09 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:10.991644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:10.993483 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:11.002375 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.003183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.004034 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.004758 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:11.005283 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:11.005938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:11.164100 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:11.173056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-95adc513-8208-4d31-b36e-e5520be9c691 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1682 microversion: 2.1 time: 0.187277 Aug 24 06:50:11.173986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 444/839] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:10 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:12.196206 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:12.197581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:12.216319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:12.226167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:12.226628 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:12.227424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:12.227894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:12.228328 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:12.383451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f264e354671d4456bb33668fb11d9636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a41fb206b09941ac80996a3c9cbaae58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:12.395706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fb6b57aa-2ff5-450f-9839-5fc1e79057a8 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 200 len: 1615 microversion: 2.1 time: 0.203579 Aug 24 06:50:12.407244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 396/840] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:12 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 1615 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:12.640765 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4a6c65-00a1-497f-8798-d2ee025cab41", "name": "network-vif-deleted", "tag": "47896dbf-b786-424c-af7b-a7ebc39518bf"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:12.674450 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:12.675086 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:12.676026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:12.739847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] Creating event network-vif-deleted:47896dbf-b786-424c-af7b-a7ebc39518bf for instance fb4a6c65-00a1-497f-8798-d2ee025cab41 on hv-cinder-85427 Aug 24 06:50:12.765280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-26ac4022-d72c-4ce4-8883-397a13335c76 req-c43b79f5-1cbf-4796-ba6b-c0f60882be2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127091 Aug 24 06:50:12.769379 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 445/841] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:13.420904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:13.422283 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:13.441269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.444189 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.444918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.445780 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:13.450378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:13.451828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:13.516002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 HTTP/1.1 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:13.518188 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:13.519917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'fb4a6c65-00a1-497f-8798-d2ee025cab41'} Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:13.520712 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:13.521943 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:13.526256 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:13.528198 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6c20d00b-ec96-4da2-8483-768b4c032cf6 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 404 len: 111 microversion: 2.1 time: 0.112150 Aug 24 06:50:13.534146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 397/842] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:13 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:13.546296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b96875e0-a62c-42e0-a5c8-a852a46f7290 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '.version_select at 0x7f3dc8538280>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:13.603536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b96875e0-a62c-42e0-a5c8-a852a46f7290 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604681102" status: 202 len: 0 microversion: 2.1 time: 0.064179 Aug 24 06:50:13.604246 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 446/843] 10.222.0.52 () {58 vars in 1221 bytes} [Wed Aug 24 06:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604681102 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:50:15.588369 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:15.588901 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:15.595793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.596531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.597417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.598133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.599032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.599032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.614878 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 HTTP/1.1 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:15.616472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.617994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'fb4a6c65-00a1-497f-8798-d2ee025cab41'} Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:15.619810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.621408 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.622907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:15.622907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5fcabf44-ea71-48a1-b045-13f83b4b6642 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 404 len: 111 microversion: 2.1 time: 0.033443 Aug 24 06:50:15.622907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 398/844] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:15 2022] DELETE /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:15.628423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:15.629893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: fb4a6c65-00a1-497f-8798-d2ee025cab41] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:15.636791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.637493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.637927 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.638628 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:15.639314 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:15.639739 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:15.654457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 HTTP/1.1 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:15.656309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.657755 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'fb4a6c65-00a1-497f-8798-d2ee025cab41'} Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:15.659139 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. Aug 24 06:50:15.661018 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:15.663045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance fb4a6c65-00a1-497f-8798-d2ee025cab41 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:15.663045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fd82056d-dd33-4717-9a05-792a05c22e51 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41" status: 404 len: 111 microversion: 2.1 time: 0.033959 Aug 24 06:50:15.663045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 447/845] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:15 2022] GET /compute/v2.1/servers/fb4a6c65-00a1-497f-8798-d2ee025cab41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:16.809866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.810736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.817681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.818163 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.818589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.819319 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.819772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.820194 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.834111 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 HTTP/1.1 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:16.835684 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.837170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '6d85df03-cf90-4dcd-baf3-0c874eb58be3'} Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:16.837942 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.839300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.840929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:16.840929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d81f91c1-3cc4-49ac-a438-a88ca39c95a4 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 404 len: 111 microversion: 2.1 time: 0.031132 Aug 24 06:50:16.840929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 399/846] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:16 2022] DELETE /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:16.848407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.849036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6d85df03-cf90-4dcd-baf3-0c874eb58be3] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.856262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.856751 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.857190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.857896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.858355 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.858782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.873462 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 HTTP/1.1 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:16.875004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.876729 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '6d85df03-cf90-4dcd-baf3-0c874eb58be3'} Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:16.877841 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. Aug 24 06:50:16.879509 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.881280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6d85df03-cf90-4dcd-baf3-0c874eb58be3 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:16.881280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e8cba1dc-5b8c-4a2e-a343-8d3c09844255 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3" status: 404 len: 111 microversion: 2.1 time: 0.033618 Aug 24 06:50:16.881280 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 448/847] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:16 2022] GET /compute/v2.1/servers/6d85df03-cf90-4dcd-baf3-0c874eb58be3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:16.886028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.886532 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.893032 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.893521 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.893982 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.894682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.895146 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.895613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.912520 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d HTTP/1.1 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:16.914060 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.915625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '193f97ea-0a83-4ece-9176-c200ed18a07d'} Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:16.916541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.918197 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.920002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:16.920002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-211022ab-0d20-4b08-987b-47cea2709254 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 404 len: 111 microversion: 2.1 time: 0.033350 Aug 24 06:50:16.920002 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 400/848] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:16 2022] DELETE /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:16.924220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:16.924955 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 193f97ea-0a83-4ece-9176-c200ed18a07d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:16.932271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.932756 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.933187 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.933872 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:16.934323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:16.934742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:16.949251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d HTTP/1.1 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:16.950748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.952838 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '193f97ea-0a83-4ece-9176-c200ed18a07d'} Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:16.953880 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. Aug 24 06:50:16.955430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:16.956904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 193f97ea-0a83-4ece-9176-c200ed18a07d could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:16.956904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-92ac39f5-f482-472e-9cb1-55eb9f102849 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d" status: 404 len: 111 microversion: 2.1 time: 0.032002 Aug 24 06:50:16.956904 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 449/849] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:16 2022] GET /compute/v2.1/servers/193f97ea-0a83-4ece-9176-c200ed18a07d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:50:19.171126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:19.171699 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:19.181123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.181464 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.181897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.182720 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.183181 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.183737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.201700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab HTTP/1.1 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:19.203324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.204978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '6eddb672-d1fa-40ab-8cae-6e148b2e01ab'} Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:19.206683 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.209210 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.211990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:19.211990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7d907061-7cba-4714-bae9-94a55d2e3cec tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 404 len: 111 microversion: 2.1 time: 0.037749 Aug 24 06:50:19.211990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 401/850] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:19 2022] DELETE /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:19.213725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:19.215249 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] [instance: 6eddb672-d1fa-40ab-8cae-6e148b2e01ab] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:19.221157 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.222183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.222183 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.222919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:19.223429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:19.223860 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:19.238950 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] HTTP exception thrown: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Request method failure captured: Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab HTTP/1.1 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciF79CbGkOW35OMcusBFWbXhlqMp502adONlGefjy1MXmauk0dy3PQX5f_blIdO8JTKuME9mmBCbwQFMsFra60qUoCC0Euzu4yDNwpiDyLVLpaeqNyb3PRRjUUXdgPZCZnkMAwrXBOMlOtW97XlczG4S8wfc2bOeaPRGVrIZYO_Hrk Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:19.240593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a41fb206b09941ac80996a3c9cbaae58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a41fb206b09941ac80996a3c9cbaae58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: a41fb206b09941ac80996a3c9cbaae58 Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-409128731 Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: f264e354671d4456bb33668fb11d9636 Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeNegativeTest-409128731-project Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.242254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '6eddb672-d1fa-40ab-8cae-6e148b2e01ab'} Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:19.243131 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. Aug 24 06:50:19.244666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:19.246004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] Returning 404 to user: Instance 6eddb672-d1fa-40ab-8cae-6e148b2e01ab could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:19.246004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b8deee62-3441-4fa2-8b6a-90fbbfa73105 tempest-AttachVolumeNegativeTest-409128731 tempest-AttachVolumeNegativeTest-409128731-project] 10.222.0.52 "GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab" status: 404 len: 111 microversion: 2.1 time: 0.032176 Aug 24 06:50:19.246004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 450/851] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:19 2022] GET /compute/v2.1/servers/6eddb672-d1fa-40ab-8cae-6e148b2e01ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:28.254467 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:28.256755 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:28.260872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:28.264927 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.265457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.265868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.266578 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.267073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.267561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.308926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f8227f10-2592-4297-afc7-23a6596cb517 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059021 Aug 24 06:50:28.309481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 402/852] 10.222.0.52 () {60 vars in 1343 bytes} [Wed Aug 24 06:50:28 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:28.385723 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:28.387177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:28.401253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:28.419104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.419640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.420426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.421153 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.421609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.422034 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.778337 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:50:28.939486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e18f946f-3add-4242-808a-d6657bcebf4e tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 204 len: 0 microversion: 2.20 time: 0.557517 Aug 24 06:50:28.944167 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 451/853] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 06:50:28 2022] DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:50:28.956043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:28.957348 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:28.966296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.967023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.968660 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:28.969303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:28.973240 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:28.973770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:29.332340 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.345989 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.353914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:29.357459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b6835b17-e19f-4e84-b1f1-ba038a87419a tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.408739 Aug 24 06:50:29.358908 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 403/854] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:28 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:30.387461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:30.388788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:30.397351 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.403619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.404331 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.405562 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:30.406192 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:30.409267 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:30.880125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.888469 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.889985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:30.891173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2697f53b-9cb6-4988-89ec-a88bc019f1ca tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1721 microversion: 2.20 time: 0.510378 Aug 24 06:50:30.891928 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 452/855] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:30 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:31.553611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efc5a50e-c3a4-4635-ad0e-2127db777881", "name": "network-vif-deleted", "tag": "7af29038-05f2-4948-9883-4601a629761c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:31.586390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.594274 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.595123 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.625486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] Creating event network-vif-deleted:7af29038-05f2-4948-9883-4601a629761c for instance efc5a50e-c3a4-4635-ad0e-2127db777881 on hv-cinder-85427 Aug 24 06:50:31.635594 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-b2d57bc7-e00f-4a26-95a8-86743b2f41b2 req-19bb242f-3dd7-4822-8817-38277c6148ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087196 Aug 24 06:50:31.642378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 404/856] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:31.918622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:31.919291 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:31.942346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.945395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.946834 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:31.948370 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:31.949804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:31.954366 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.091940 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:32.092387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:32.097587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:32.098099 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lazy-loading 'fault' on Instance uuid efc5a50e-c3a4-4635-ad0e-2127db777881 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:50:32.407636 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.416791 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:32.426428 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.432947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bfb5dc1fa16f465ba1ebca000b665d46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0aec98515a95467aa9a43853bfdcb7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:32.442706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-26380a9c-8d97-4c74-af8e-2873bbbe3483 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 200 len: 1371 microversion: 2.20 time: 0.527566 Aug 24 06:50:32.445444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 453/857] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:31 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 1371 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:50:33.472737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:33.475222 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:33.492599 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.494663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.496831 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:33.497767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:33.499741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:33.501294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:33.542497 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 HTTP/1.1 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:33.546044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:33.547737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'efc5a50e-c3a4-4635-ad0e-2127db777881'} Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:33.548504 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:33.549787 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:33.557023 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:33.557899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2310bf33-d6bb-4b00-8e03-a414b33afc61 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 404 len: 111 microversion: 2.20 time: 0.091783 Aug 24 06:50:33.558662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 405/858] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:33 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:50:33.573707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4392bb5e-4117-4704-994d-128c4a1e2b2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '.version_select at 0x7f3dc86720d0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:33.638268 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4392bb5e-4117-4704-994d-128c4a1e2b2b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058508282" status: 204 len: 0 microversion: 2.20 time: 0.073204 Aug 24 06:50:33.642202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 454/859] 10.222.0.52 () {60 vars in 1262 bytes} [Wed Aug 24 06:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058508282 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:50:36.439490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:36.440404 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:36.453214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.459864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2163fb85-0d3e-4657-8c33-8f07fae4b749 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Action: 'create', calling method: .version_select at 0x7f3dc865c040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1634728052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMXj0SCA56IsFgXD1P/UgAumTMUH1E6z72libcTZHeIkdHrHBOYWhMKXHzN87/YSzmpSzm6nVSjdWH5fAn7zapeaAWbUBeLQYY3rL96t30GHXnEJfbPd4ajOnCr6nZAUQ=="}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:36.475125 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.476902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.478075 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.480917 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.483620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.517952 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-2163fb85-0d3e-4657-8c33-8f07fae4b749 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for project 13dae75bec47489cac0248f2bb2c197d. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:50:36.529487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-2163fb85-0d3e-4657-8c33-8f07fae4b749 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for user 0b23553f7543446cb5eca18f26e25816 and project 13dae75bec47489cac0248f2bb2c197d. Resources: {'key_pairs'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:50:36.538807 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 HTTP/1.1 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:36.542660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.544689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'efc5a50e-c3a4-4635-ad0e-2127db777881'} Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:36.545490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.546971 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.548621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:36.548621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9631700f-28e7-4d96-89cd-eb9b0f7b371b tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 404 len: 111 microversion: 2.20 time: 0.115803 Aug 24 06:50:36.548621 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 455/860] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 06:50:36 2022] DELETE /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:50:36.559070 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:36.561325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: efc5a50e-c3a4-4635-ad0e-2127db777881] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:36.575821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.576286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.577222 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.588010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:36.589759 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:36.589957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2163fb85-0d3e-4657-8c33-8f07fae4b749 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.432852 Aug 24 06:50:36.590759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 406/861] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:50:36 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:36.597718 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:36.629946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 HTTP/1.1 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:36.631553 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.635259 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': 'efc5a50e-c3a4-4635-ad0e-2127db777881'} Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:36.636230 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. Aug 24 06:50:36.637853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:36.644446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance efc5a50e-c3a4-4635-ad0e-2127db777881 could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:36.646069 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-70713429-91b3-4aab-86fc-7f96230a4176 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881" status: 404 len: 111 microversion: 2.20 time: 0.096539 Aug 24 06:50:36.646936 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 456/862] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:36 2022] GET /compute/v2.1/servers/efc5a50e-c3a4-4635-ad0e-2127db777881 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:50:37.927583 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:37.928772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:37.936753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.937673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.938288 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.939175 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.939990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.940589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.955814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b HTTP/1.1 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:37.958237 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:37.959996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b'} Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:37.960929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:37.962448 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:37.965656 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:37.966758 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-673badee-870c-4046-9e88-da736e947537 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 404 len: 111 microversion: 2.20 time: 0.043409 Aug 24 06:50:37.968216 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 407/863] 10.222.0.52 () {60 vars in 1280 bytes} [Wed Aug 24 06:50:37 2022] DELETE /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:50:37.976567 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:37.977193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] [instance: 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:37.984627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.985140 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.985592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:37.986391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:37.987113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:37.987606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:38.003780 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] HTTP exception thrown: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Request method failure captured: Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b HTTP/1.1 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBciRhIdBokk81InK6YE3pfYMUPhmwe69rMqLz8RvmAjr0uZrjojKPBPvXcRXlVtUdCKKb-dOnTc7wbLALhOq8_Bf9XqOxNSBEUQym7r0sWs418wDT6P8YRiKKfO1bEisKxzyWRFoAPPCCFuOm4t3Xam_ta73k_cnCcQWKqckwq7xNiw Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:38.005286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0aec98515a95467aa9a43853bfdcb7d7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0aec98515a95467aa9a43853bfdcb7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0aec98515a95467aa9a43853bfdcb7d7 Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-734238483 Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: bfb5dc1fa16f465ba1ebca000b665d46 Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-AttachVolumeShelveTestJSON-734238483-project Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:38.006749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b'} Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:38.007615 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. Aug 24 06:50:38.009416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:38.010777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] Returning 404 to user: Instance 7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:38.010777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-9c3f3c6a-9ef0-41e1-ace8-306f04895187 tempest-AttachVolumeShelveTestJSON-734238483 tempest-AttachVolumeShelveTestJSON-734238483-project] 10.222.0.52 "GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b" status: 404 len: 111 microversion: 2.20 time: 0.034222 Aug 24 06:50:38.010777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 457/864] 10.222.0.52 () {60 vars in 1277 bytes} [Wed Aug 24 06:50:37 2022] GET /compute/v2.1/servers/7a4b142a-d9d1-4b9b-b7f6-d6ed3089182b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:50:39.567788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:39.571079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:39.593228 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.593739 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.594180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:39.597941 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.602229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.602782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:39.678967 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Going to try to terminate instance {{(pid=127290) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:50:39.848580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d819d5a3-068d-44c7-8ec0-42fc72f8df39 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 204 len: 0 microversion: 2.1 time: 0.290744 Aug 24 06:50:39.849742 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 408/865] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:50:39 2022] DELETE /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:50:39.860679 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:39.861460 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:39.874069 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.874872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.876897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:39.882869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:39.883618 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:39.884208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.093343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:40.117811 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:40.119436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:40.120094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:40.152489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] Creating event network-changed:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:50:40.173866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-f49f06c5-f258-4ab4-a82d-710c1197cd34 req-5c1f98c4-99da-4438-9e16-5e0b5eaeec19 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511258 Aug 24 06:50:40.174870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 458/866] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:50:40.698169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:40.718299 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0a6b0f31-18b9-4bad-9811-cc8f65bf2b6a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.860885 Aug 24 06:50:40.731917 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 409/867] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:39 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:50:41.743550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:41.744924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:41.761684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.763248 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.765753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:41.769619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:41.772175 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:41.773602 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:42.281972 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:42.324510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-716bb210-3159-4979-958f-21904208ab7a tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1563 microversion: 2.1 time: 0.586392 Aug 24 06:50:42.328255 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 459/868] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:41 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1563 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:42.996572 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb639cc-8b84-4663-b991-2954e9c87fef", "name": "network-vif-deleted", "tag": "23d72516-fd9a-4990-84c2-92849cc63fb1"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:43.025082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.025842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.030081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.040936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:43.059728 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] Creating event network-vif-deleted:23d72516-fd9a-4990-84c2-92849cc63fb1 for instance cdb639cc-8b84-4663-b991-2954e9c87fef on hv-cinder-85427 Aug 24 06:50:43.069094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-b0722636-6cde-4b6b-b9d8-42970871274e req-1f5f5b06-1a48-45f2-9e15-b87eee2e4fa6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081509 Aug 24 06:50:43.070433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 410/869] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:43.350869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:43.354659 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:43.390144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.393600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.394725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.397981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:43.398561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:43.399016 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:43.625356 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7957b80bf6e843d4a7a0b11f13a80db8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf38c354bea44f5a503e76fa53b20f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:43.635703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b4f864fa-0295-4338-a64a-e307836ca564 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 200 len: 1218 microversion: 2.1 time: 0.290873 Aug 24 06:50:43.637561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 460/870] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:43 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:50:44.658337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:44.659177 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] [instance: cdb639cc-8b84-4663-b991-2954e9c87fef] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:44.677363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.677859 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.678531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.681030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:44.681738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:44.682831 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:44.717766 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] HTTP exception thrown: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Request method failure captured: Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef HTTP/1.1 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcjtfnjRxq1tVSM2CxKJi5p_eJsRwK8CdHBKPe_bHyHsaVFw6G02RV81itSbkikl_lrhW1WxFSCxTC4VaoGbCXgJjCPtXwdwlApyIF8fqUoxZ2dfp9PyxijxR_i49DdayCj9BNL3o3oX-XE_08fuKFhOXQjZpztlKfZ1bP27gza03zY Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0bf38c354bea44f5a503e76fa53b20f6 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestShelveInstance-684590379 Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:44.719947 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bf38c354bea44f5a503e76fa53b20f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bf38c354bea44f5a503e76fa53b20f6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bf38c354bea44f5a503e76fa53b20f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bf38c354bea44f5a503e76fa53b20f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestShelveInstance-684590379 Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0bf38c354bea44f5a503e76fa53b20f6 Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestShelveInstance-684590379 Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestShelveInstance-684590379-project Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 7957b80bf6e843d4a7a0b11f13a80db8 Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestShelveInstance-684590379-project Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. Aug 24 06:50:44.721814 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'cdb639cc-8b84-4663-b991-2954e9c87fef'} Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:44.722858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. Aug 24 06:50:44.724601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:44.727925 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Returning 404 to user: Instance cdb639cc-8b84-4663-b991-2954e9c87fef could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:44.732167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6a389d6d-cad2-4beb-8a0c-41849e8bc0f1 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef" status: 404 len: 111 microversion: 2.1 time: 0.078659 Aug 24 06:50:44.735327 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 411/871] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:44 2022] GET /compute/v2.1/servers/cdb639cc-8b84-4663-b991-2954e9c87fef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:45.105548 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-29e60ecb-23cc-4e8e-94a0-cb4115928743 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] Calling method '.version_select at 0x7f3dc877c1f0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:45.132776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-29e60ecb-23cc-4e8e-94a0-cb4115928743 tempest-TestShelveInstance-684590379 tempest-TestShelveInstance-684590379-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-961081060" status: 202 len: 0 microversion: 2.1 time: 0.031526 Aug 24 06:50:45.133358 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 461/872] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-961081060 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:50:47.160911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=4 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:47.459959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-754e6f74-5aa5-4038-846b-bb0fbffbfc12 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Action: 'create', calling method: .version_select at 0x7f3dc89db550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1213673178"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:47.864154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-754e6f74-5aa5-4038-846b-bb0fbffbfc12 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.708963 Aug 24 06:50:47.865453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 412/873] 10.222.0.52 () {60 vars in 1155 bytes} [Wed Aug 24 06:50:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 712 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:50:47.887325 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b1e84290-2cbd-4ede-9bc1-1c4334f1734a tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc8672700>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:47.992550 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b1e84290-2cbd-4ede-9bc1-1c4334f1734a tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 200 len: 345 microversion: 2.1 time: 0.115520 Aug 24 06:50:47.993412 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 462/874] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:50:47 2022] GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:49.006359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1ccb2751-3988-487f-8fd6-f242c893eb76 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc850aca0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.069653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1ccb2751-3988-487f-8fd6-f242c893eb76 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 200 len: 346 microversion: 2.1 time: 0.067295 Aug 24 06:50:49.070423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 413/875] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:49.083415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e36cdcee-6227-4d17-83c9-eed26ba0ff73 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Action: 'create', calling method: .version_select at 0x7f3dc8590c10>, body: {"snapshot": {"volume_id": "8885a029-98c4-4661-b319-f776230eb66c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-536786424"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:49.333367 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e36cdcee-6227-4d17-83c9-eed26ba0ff73 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.254553 Aug 24 06:50:49.334026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 463/876] 10.222.0.52 () {60 vars in 1162 bytes} [Wed Aug 24 06:50:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:49.345442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b9ccf46e-6951-4896-9126-f1e82f3f6e88 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc84b8670>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.381264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b9ccf46e-6951-4896-9126-f1e82f3f6e88 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 286 microversion: 2.1 time: 0.040585 Aug 24 06:50:49.394294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 414/877] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:49.404637 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-351ceb31-368d-478a-836d-a7c2c1196379 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc879bb80>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.463633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-351ceb31-368d-478a-836d-a7c2c1196379 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.062132 Aug 24 06:50:49.465381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 464/878] 10.222.0.52 () {58 vars in 1140 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:49.477040 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-568e9467-bdf5-4438-89ca-8f5c8af832f1 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc850a3a0>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:49.516050 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-568e9467-bdf5-4438-89ca-8f5c8af832f1 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 286 microversion: 2.1 time: 0.042934 Aug 24 06:50:49.517450 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 415/879] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:49 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:50.533732 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-68eaac0e-96d9-480a-a450-546140a398e8 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc87c9b80>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:50.570739 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-68eaac0e-96d9-480a-a450-546140a398e8 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 286 microversion: 2.1 time: 0.043031 Aug 24 06:50:50.571649 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 465/880] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:50 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:51.584485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-af376f80-66fe-4f29-a3b8-a7be8053dcc4 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc865c940>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:51.615044 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-af376f80-66fe-4f29-a3b8-a7be8053dcc4 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 286 microversion: 2.1 time: 0.035155 Aug 24 06:50:51.615647 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 416/881] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:51 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:52.632912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-39a83d93-5f1d-4dad-ad64-db913bab8be8 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc84fbaf0>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:52.672133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-39a83d93-5f1d-4dad-ad64-db913bab8be8 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 287 microversion: 2.1 time: 0.047569 Aug 24 06:50:52.672703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 466/882] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:52 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:52.686131 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-8e90d60e-32bf-4a97-b261-47ddb1d41f10 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc850a040>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:52.771062 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-8e90d60e-32bf-4a97-b261-47ddb1d41f10 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 202 len: 0 microversion: 2.1 time: 0.090528 Aug 24 06:50:52.771761 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 417/883] 10.222.0.52 () {58 vars in 1254 bytes} [Wed Aug 24 06:50:52 2022] DELETE /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:50:52.780495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8885ea5d-c5f3-435e-a6ae-639ac16694bc tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc877cc10>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:52.810946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8885ea5d-c5f3-435e-a6ae-639ac16694bc tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 200 len: 286 microversion: 2.1 time: 0.034645 Aug 24 06:50:52.811823 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 467/884] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:52 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:53.825141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e59c1de8-a729-4e87-93dd-be1ec77887ee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc85f3f70>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.852230 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-e59c1de8-a729-4e87-93dd-be1ec77887ee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] HTTP exception thrown: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e59c1de8-a729-4e87-93dd-be1ec77887ee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Request method failure captured: Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc HTTP/1.1 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcpHMMvxz4J9Uxru9gxKgOr9R1jbv26Arph5M5mPm9T_AIjY5AptfLhXNkPZLY3bOa4rfcri3e7jDV86qBDtW3xe6onj52vQHhjBDqz9LP3nfXtJuh87mEe4ow5aIXon6oTDRSrjisUa8Zr-LSXcSw4rcvVspUwoReYMTvbUkzDd004 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:53.855106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bc596aa9feb471a9e0d32cb4a951002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 66971d1a42114fc7acd7f8f372ea681e Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': 'c8e51818-a1ef-4ac2-90f3-c876dfe761fc'} Aug 24 06:50:53.856876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. (HTTP 404) (Request-ID: req-a2859fda-f5b1-4735-a348-7748c89b1e10) Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.857898 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:53.859351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 06:50:53.860799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e59c1de8-a729-4e87-93dd-be1ec77887ee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Returning 404 to user: Snapshot c8e51818-a1ef-4ac2-90f3-c876dfe761fc could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e59c1de8-a729-4e87-93dd-be1ec77887ee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc" status: 404 len: 111 microversion: 2.1 time: 0.037375 Aug 24 06:50:53.862292 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 418/885] 10.222.0.52 () {58 vars in 1251 bytes} [Wed Aug 24 06:50:53 2022] GET /compute/v2.1/os-snapshots/c8e51818-a1ef-4ac2-90f3-c876dfe761fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:53.866165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=21 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:53.870474 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-53a734d6-91df-46b2-a24c-b7bd3bad215c tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc879c310>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:53.938591 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-53a734d6-91df-46b2-a24c-b7bd3bad215c tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 202 len: 0 microversion: 2.1 time: 0.073651 Aug 24 06:50:53.939284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 468/886] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:50:53 2022] DELETE /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:50:53.948389 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f440938b-f393-4fbe-8e46-a6604b92930a tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc8a23820>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:54.005383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f440938b-f393-4fbe-8e46-a6604b92930a tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 200 len: 345 microversion: 2.1 time: 0.060943 Aug 24 06:50:54.006385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 419/887] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:50:53 2022] GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:50:55.019803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-be497048-bf16-4a19-8c1c-a1dddd6bde40 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc8672a60>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:55.055317 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-be497048-bf16-4a19-8c1c-a1dddd6bde40 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] HTTP exception thrown: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-be497048-bf16-4a19-8c1c-a1dddd6bde40 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Request method failure captured: Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c HTTP/1.1 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcpHMMvxz4J9Uxru9gxKgOr9R1jbv26Arph5M5mPm9T_AIjY5AptfLhXNkPZLY3bOa4rfcri3e7jDV86qBDtW3xe6onj52vQHhjBDqz9LP3nfXtJuh87mEe4ow5aIXon6oTDRSrjisUa8Zr-LSXcSw4rcvVspUwoReYMTvbUkzDd004 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:55.058802 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bc596aa9feb471a9e0d32cb4a951002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 66971d1a42114fc7acd7f8f372ea681e Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '8885a029-98c4-4661-b319-f776230eb66c'} Aug 24 06:50:55.060890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. (HTTP 404) (Request-ID: req-3be58833-5d7a-429d-a7bf-31098a6c7eea) Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.070564 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:55.072094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:50:55.073534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-be497048-bf16-4a19-8c1c-a1dddd6bde40 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Returning 404 to user: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-be497048-bf16-4a19-8c1c-a1dddd6bde40 tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 404 len: 109 microversion: 2.1 time: 0.044992 Aug 24 06:50:55.076053 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 469/888] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:50:55 2022] GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:55.078279 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c6a220d4-4472-45ed-b5a4-6262759f2eee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc850af70>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:55.081134 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:55.082056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:55.109781 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-c6a220d4-4472-45ed-b5a4-6262759f2eee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] HTTP exception thrown: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c6a220d4-4472-45ed-b5a4-6262759f2eee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Request method failure captured: Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c HTTP/1.1 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcpHMMvxz4J9Uxru9gxKgOr9R1jbv26Arph5M5mPm9T_AIjY5AptfLhXNkPZLY3bOa4rfcri3e7jDV86qBDtW3xe6onj52vQHhjBDqz9LP3nfXtJuh87mEe4ow5aIXon6oTDRSrjisUa8Zr-LSXcSw4rcvVspUwoReYMTvbUkzDd004 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:50:55.111853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bc596aa9feb471a9e0d32cb4a951002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 66971d1a42114fc7acd7f8f372ea681e Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '8885a029-98c4-4661-b319-f776230eb66c'} Aug 24 06:50:55.113516 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. (HTTP 404) (Request-ID: req-a4177bde-1a9a-4418-823b-0cb7478b5c37) Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.114588 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:50:55.116249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:50:55.118057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c6a220d4-4472-45ed-b5a4-6262759f2eee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Returning 404 to user: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c6a220d4-4472-45ed-b5a4-6262759f2eee tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 404 len: 109 microversion: 2.1 time: 0.042528 Aug 24 06:50:55.119561 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 420/889] 10.222.0.52 () {58 vars in 1248 bytes} [Wed Aug 24 06:50:55 2022] DELETE /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:55.122209 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-61c505ac-fdab-4086-af8b-c6c3ab48d8bd tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Calling method '.version_select at 0x7f3dc8672280>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:55.129261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:55.152804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-61c505ac-fdab-4086-af8b-c6c3ab48d8bd tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] HTTP exception thrown: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-61c505ac-fdab-4086-af8b-c6c3ab48d8bd tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Request method failure captured: Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c HTTP/1.1 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcpHMMvxz4J9Uxru9gxKgOr9R1jbv26Arph5M5mPm9T_AIjY5AptfLhXNkPZLY3bOa4rfcri3e7jDV86qBDtW3xe6onj52vQHhjBDqz9LP3nfXtJuh87mEe4ow5aIXon6oTDRSrjisUa8Zr-LSXcSw4rcvVspUwoReYMTvbUkzDd004 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:50:55.154747 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0bc596aa9feb471a9e0d32cb4a951002", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0bc596aa9feb471a9e0d32cb4a951002"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 0bc596aa9feb471a9e0d32cb4a951002 Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-204451751 Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 66971d1a42114fc7acd7f8f372ea681e Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-VolumesSnapshotsTestJSON-204451751-project Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '8885a029-98c4-4661-b319-f776230eb66c'} Aug 24 06:50:55.156353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. (HTTP 404) (Request-ID: req-abd66499-841b-43cd-8147-b2b343b0ade5) Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.157514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:50:55.159179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:50:55.160730 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-61c505ac-fdab-4086-af8b-c6c3ab48d8bd tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] Returning 404 to user: Volume 8885a029-98c4-4661-b319-f776230eb66c could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-61c505ac-fdab-4086-af8b-c6c3ab48d8bd tempest-VolumesSnapshotsTestJSON-204451751 tempest-VolumesSnapshotsTestJSON-204451751-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c" status: 404 len: 109 microversion: 2.1 time: 0.037922 Aug 24 06:50:55.162200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 470/890] 10.222.0.52 () {58 vars in 1245 bytes} [Wed Aug 24 06:50:55 2022] GET /compute/v2.1/os-volumes/8885a029-98c4-4661-b319-f776230eb66c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:57.978719 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-722391529", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1634728052", "security_groups": [{"name": "tempest-secgroup-smoke-1819948811"}], "block_device_mapping_v2": [{"uuid": "c0ee99d7-0985-4d14-9559-a3e99aaf3a6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac79ef75-2295-49c5-bcaa-808b501af7f4"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:50:58.129284 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] validate_networks() for [('ac79ef75-2295-49c5-bcaa-808b501af7f4', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:50:58.712948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:50:58.713377 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:50:58.714010 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:50:58.714934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:50:58.715546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:50:58.726850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:58.727757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:58.728393 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:58.729243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:50:58.729736 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:50:58.730166 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:50:58.750498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:50:58.755978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for user 0b23553f7543446cb5eca18f26e25816 and project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:50:58.826418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:50:58.828680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0ee99d7-0985-4d14-9559-a3e99aaf3a6f',volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:50:58.973597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fd399882-c442-4158-a1c2-9e3279dfcf2f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.999292 Aug 24 06:50:58.974242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 421/891] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:50:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:50:58.986764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-57500a13-6b55-4a08-b4d2-6d373e6ad747 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:50:58.987551 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-57500a13-6b55-4a08-b4d2-6d373e6ad747 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:50:59.046725 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-57500a13-6b55-4a08-b4d2-6d373e6ad747 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:50:59.056745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-57500a13-6b55-4a08-b4d2-6d373e6ad747 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1094 microversion: 2.1 time: 0.074897 Aug 24 06:50:59.057771 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 471/892] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:50:58 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:00.081124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:00.082418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:00.094754 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:00.095427 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:00.096330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:00.097442 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:00.098314 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:00.099631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:00.227094 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:00.242461 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e600898c-d791-4e0f-bf07-64a612cddf25 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1210 microversion: 2.1 time: 0.168070 Aug 24 06:51:00.243349 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 422/893] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:00 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:51:01.265832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:01.266515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:01.277923 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:01.278503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:01.278960 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:01.279761 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:01.284557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:01.285026 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:01.584430 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:01.593062 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-12fabbf9-0ad0-4f64-ad5f-e051212b90ef tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.332702 Aug 24 06:51:01.593670 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 472/894] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:01 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:02.262168 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710ba31c-fd62-4a0b-ac84-d9b51862b83c", "tag": "c74c1f51-88a4-4332-bfae-b1e2f3279b3e"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:51:02.276813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.277560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.278914 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.297028 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] Creating event network-changed:c74c1f51-88a4-4332-bfae-b1e2f3279b3e for instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c on hv-cinder-85427 Aug 24 06:51:02.302889 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-ce4b0516-c183-4cf6-a250-6e6c2aad76b9 req-444fa641-66a9-452c-84ee-ea58efbb6afb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045188 Aug 24 06:51:02.304151 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 423/895] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:51:02.615043 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:02.615820 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:02.623409 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.623998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.624526 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.625439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:02.625986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:02.630213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:02.906632 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:02.928847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ac6493f6-1c7f-45a3-b124-bef80e523cdf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.318310 Aug 24 06:51:02.934330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 473/896] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:02 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:03.957772 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:03.958721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:03.980425 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:03.983737 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:03.984312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:03.985313 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:03.986288 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:03.987786 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:04.149481 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:04.157676 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6577070f-9abc-4d40-8635-b0fb0bccca36 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.206444 Aug 24 06:51:04.158411 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 424/897] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:03 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:05.180193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:05.181015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:05.189171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:05.189962 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:05.191042 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:05.192203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:05.192912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:05.193894 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:05.370373 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:05.378705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6bdcee6d-0e6a-4453-b2a9-8ef6142b4ca5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.202533 Aug 24 06:51:05.379305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 474/898] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:05 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:06.401349 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:06.402027 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:06.412906 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:06.413793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:06.414390 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:06.415271 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:06.415916 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:06.416345 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:06.565318 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:06.574488 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f51c29d2-2e80-4dec-a9ff-95fd47d4be7f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.178411 Aug 24 06:51:06.575142 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 425/899] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:06 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:07.600664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:07.601488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:07.612098 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:07.613072 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:07.613633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:07.614565 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:07.615030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:07.615539 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:07.767093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:07.778342 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8a922152-6d60-489d-903a-bd1effe251c2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.183784 Aug 24 06:51:07.779103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 475/900] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:07 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:08.801122 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:08.801861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:08.804721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:08.805420 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:08.811829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:08.812321 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:08.812756 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:08.813457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:08.813911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:08.814338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:08.952114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:08.960042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-542a4f11-7597-40ee-afd5-8011cce36aa6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.162863 Aug 24 06:51:08.960741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 426/901] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:08 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:09.982979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:09.983673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:09.986013 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:09.991810 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:09.992292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:09.992721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:09.993415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:09.993866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:09.994286 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:10.141281 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:10.150927 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-2223985f-0743-491b-8474-9f6239ed241f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.174238 Aug 24 06:51:10.151691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 476/902] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:09 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:11.175733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:11.176591 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:11.184414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:11.184929 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:11.185779 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:11.186493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:11.186951 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:11.187533 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:11.324338 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:11.333936 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-33304190-65c8-4849-bc9c-2e9e2364db1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.163204 Aug 24 06:51:11.334434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 427/903] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:11 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:12.357274 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:12.357979 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:12.368701 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:12.369492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:12.370206 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:12.371422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:12.372179 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:12.372899 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:12.554592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:12.564905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-277171c5-8543-428f-bf49-bec3802f40e0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.213034 Aug 24 06:51:12.565583 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 477/904] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:12 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:12.609502 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ba31c-fd62-4a0b-ac84-d9b51862b83c", "name": "network-vif-plugged", "status": "completed", "tag": "c74c1f51-88a4-4332-bfae-b1e2f3279b3e"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:51:12.621147 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:12.621775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:12.622315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:12.641065 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] Creating event network-vif-plugged:c74c1f51-88a4-4332-bfae-b1e2f3279b3e for instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c on hv-cinder-85427 Aug 24 06:51:12.648661 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-b7f1d283-113f-4457-bc23-54074ccbdffe req-58d50df6-3221-4f30-a235-adb30332e3cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042786 Aug 24 06:51:12.649613 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 428/905] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:51:13.587774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:13.588401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:13.595764 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:13.596261 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:13.596798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:13.597489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:13.597947 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:13.598381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:13.735908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:13.747716 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cd7eb43a-bc1a-40f1-a72a-acdf02ef3d1a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.163724 Aug 24 06:51:13.748266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 478/906] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:13 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:14.780250 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:14.781112 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:14.787863 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:14.788383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:14.788828 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:14.789548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:14.789995 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:14.790412 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:14.940489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:14.948414 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2a881b0a-8ace-4634-b306-ff7874256cad tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.173190 Aug 24 06:51:14.948974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 429/907] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:14 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:15.969443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:15.970060 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:15.977350 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:15.977859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:15.978298 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:15.979005 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:15.979503 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:15.979946 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:16.125822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:16.136488 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4b069fb1-1d6a-49be-a032-26e8cbe730d2 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1266 microversion: 2.1 time: 0.171132 Aug 24 06:51:16.137056 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 479/908] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:15 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:17.162249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:17.163255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:17.174208 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:17.174997 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:17.175757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:17.176899 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:17.177640 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:17.178336 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:17.329799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:17.340298 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0cfa4cdc-cae8-42df-90de-d6198cc05ee5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1453 microversion: 2.1 time: 0.185529 Aug 24 06:51:17.340905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 430/909] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:17 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:17.365120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:51:17.365754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:51:17.371934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:17.372429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:17.372908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:17.373606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:17.374066 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:17.374515 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:17.523853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:51:17.532408 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7fedac81-48ef-464d-91f9-00ac59d6c7a5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1453 microversion: 2.1 time: 0.171235 Aug 24 06:51:17.532997 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 480/910] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:51:17 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1453 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:51:19.748807 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "710ba31c-fd62-4a0b-ac84-d9b51862b83c", "tag": "c74c1f51-88a4-4332-bfae-b1e2f3279b3e"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:51:19.759449 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:19.760303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:19.760826 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:19.772746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] Creating event network-changed:c74c1f51-88a4-4332-bfae-b1e2f3279b3e for instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c on hv-cinder-85427 Aug 24 06:51:19.778990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-c753038b-fd79-41ce-8eac-44f11b25577f req-4a355fa8-168e-431d-bf6a-9324409c3359 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034898 Aug 24 06:51:19.780075 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 431/911] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:21.913463 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=22 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:21.914235 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=54 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:21.918312 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-4b00af45-a7c7-4ca7-9f87-79ee4c1277fb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'create', calling method: .version_select at 0x7f3dc8663790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1357987431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEE4Kjmuq1v6pwClBMv1YG1S6p0WKuovbW1NxZp1+9kC/jY0yI+FSeTXpPz7RjniPkE5G3RQ4kkXP4lj0SKrArw1k4xgzDEFXtpS9BHT/q77ptZhz0qHI6qxg6e/MzZMQg=="}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:21.936105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-4b00af45-a7c7-4ca7-9f87-79ee4c1277fb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Getting quotas for project df1bd62253b1499d967691558359d094. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:52:21.940493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.quota [None req-4b00af45-a7c7-4ca7-9f87-79ee4c1277fb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Getting quotas for user 6e2a0358c66f47608554ef937ae57e50 and project df1bd62253b1499d967691558359d094. Resources: {'key_pairs'} {{(pid=127291) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:52:21.966123 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-4b00af45-a7c7-4ca7-9f87-79ee4c1277fb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054324 Aug 24 06:52:21.966686 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 481/912] 10.222.0.52 () {60 vars in 1159 bytes} [Wed Aug 24 06:52:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:22.073867 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:22.074635 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=50 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:22.080115 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1720620920", "imageRef": "48bbf865-38f3-456a-9253-40787e7dad60", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1357987431", "networks": [{"uuid": "a6c677ab-6af0-4f2c-a283-77f539b0b8c3"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:22.134802 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] validate_networks() for [('a6c677ab-6af0-4f2c-a283-77f539b0b8c3', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:52:22.524733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:52:22.525268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:52:22.525918 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:52:22.526486 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:52:22.527090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:52:22.537579 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:22.538234 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:22.538713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:22.539607 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:22.540201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:22.540629 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:22.558884 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Getting quotas for project df1bd62253b1499d967691558359d094. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:52:22.563800 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Getting quotas for user 6e2a0358c66f47608554ef937ae57e50 and project df1bd62253b1499d967691558359d094. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:52:22.575662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:52:22.578011 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48bbf865-38f3-456a-9253-40787e7dad60',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:52:22.628142 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-34737b13-eabb-4efb-95ad-6c2f9dab7180 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556437 Aug 24 06:52:22.628850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 432/913] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:52:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:52:22.639867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-6da5bc26-adb0-4eef-9906-43297b91125d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:22.640523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-6da5bc26-adb0-4eef-9906-43297b91125d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:22.707957 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-6da5bc26-adb0-4eef-9906-43297b91125d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:22.717120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-6da5bc26-adb0-4eef-9906-43297b91125d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1259 microversion: 2.1 time: 0.081433 Aug 24 06:52:22.717672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 482/914] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:22 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:23.743055 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:23.744124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:23.756570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:23.757802 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:23.758413 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:23.759169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:23.759763 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:23.760190 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:23.824548 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:23.833057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-533d5e6d-5be2-4da8-9202-b0483e6f3552 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1311 microversion: 2.1 time: 0.097549 Aug 24 06:52:23.833637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 433/915] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:23 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:24.863592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:24.864930 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:24.874832 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:24.875643 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:24.876508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:24.877099 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:24.877566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:24.882650 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:25.067025 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:25.075110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-7e6c6c2f-7cba-48aa-b2ed-545ec97a9147 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.224475 Aug 24 06:52:25.075704 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 483/916] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:24 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:26.097731 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:26.099353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:26.106974 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:26.107498 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:26.108135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:26.108921 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:26.109381 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:26.109815 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:26.253517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:26.261663 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-75d9bb89-07da-41ee-bf62-f9439f880599 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.169223 Aug 24 06:52:26.262312 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 434/917] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:26 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:27.282902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:27.283788 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:27.290724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:27.291234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:27.291662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:27.292362 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:27.292813 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:27.293204 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:27.437002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:27.445983 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-63be7c3a-049e-4781-bab4-766481fd81dc tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.167115 Aug 24 06:52:27.447633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 484/918] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:27 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:28.469624 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:28.470355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:28.477487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:28.477884 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:28.478373 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:28.479086 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:28.479489 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:28.479930 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:28.621235 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:28.629768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-7bb5eda6-b9ce-45b3-831f-f0b0563db2e0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.164134 Aug 24 06:52:28.630721 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 435/919] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:28 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:29.652721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:29.654323 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:29.661322 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:29.661963 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:29.662460 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:29.663243 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:29.663776 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:29.664224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:29.803587 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:29.811873 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fba70b1f-19d0-46af-b3bc-6f4c4656b7c1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.163502 Aug 24 06:52:29.824925 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 485/920] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:29 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:30.835082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:30.835900 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:30.842871 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:30.843398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:30.843862 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:30.844553 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:30.845012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:30.845434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:31.020639 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:31.027351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-45450830-2731-44d4-b608-4f490d1f45cb tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.196983 Aug 24 06:52:31.028162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 436/921] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:30 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:32.048441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:32.049105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:32.055999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:32.056490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:32.056905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:32.057606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:32.058093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:32.058493 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:32.200341 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:32.208981 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f975d378-b11a-4468-a2ce-38e15e1eadc0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.164433 Aug 24 06:52:32.209754 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 486/922] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:32 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:32.984409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:32.989812 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:32.997783 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:33.005005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:33.005468 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:33.005902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:33.022443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] Creating event network-changed:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:52:33.030774 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-2089ed9d-f77b-425f-a724-8560088129d6 req-a5a492d9-df2c-4bd0-8967-f9250ca0f345 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050989 Aug 24 06:52:33.031437 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 437/923] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:33.233347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:33.234224 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:33.236893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=6 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:33.243523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:33.244015 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:33.244457 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:33.245169 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:33.245653 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:33.246079 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:33.386415 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:33.394529 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f2bfcf4e-f543-4153-af89-9b93fe0daae1 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.166796 Aug 24 06:52:33.395132 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 487/924] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:33 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:34.417119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:34.418048 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:34.426868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:34.427391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:34.427836 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:34.428539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:34.428998 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:34.429463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:34.589323 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:34.598089 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b3d33baf-4c04-478d-a3f6-c7a2c15aee14 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.186701 Aug 24 06:52:34.598662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 438/925] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:34 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:35.623741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:35.624833 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:35.633411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.633908 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.634353 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.635054 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:35.635561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:35.635995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:35.775539 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:35.784103 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-47bd85ec-d684-44c5-85b1-d04377bfe3fe tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.166778 Aug 24 06:52:35.784687 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 488/926] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:35 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:36.805350 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:36.805948 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:36.813119 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:36.813611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:36.814054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:36.814744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:36.815218 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:36.815662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:36.950939 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:36.959515 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-26a13006-ab4f-4107-a3bf-7b5d2233d246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.158244 Aug 24 06:52:36.960315 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 439/927] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:36 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:37.984924 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:37.985903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:37.998869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:37.999740 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:38.000489 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:38.001673 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:38.002436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:38.003154 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:38.160129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:38.172639 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-05652c28-ab7e-4fc9-be37-038a1fcae7c6 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.194004 Aug 24 06:52:38.173416 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 489/928] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:37 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:38.945934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "name": "network-vif-plugged", "status": "completed", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:38.956383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:38.956988 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:38.957451 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:38.968998 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] Creating event network-vif-plugged:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:52:38.973853 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-76d2a236-0adf-4d94-ae58-677d51c4bdf1 req-a8889cbc-30a8-46eb-a156-3e14e2522632 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Aug 24 06:52:38.974416 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 440/929] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:39.194996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:39.195790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:39.202586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:39.203057 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:39.203534 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:39.204242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:39.204717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:39.205141 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:39.341937 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:39.352123 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a1d989e1-2f13-4b02-b4a8-0cd496e1dc02 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.161207 Aug 24 06:52:39.352693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 490/930] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:39 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:40.379114 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:40.379868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:40.386643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:40.387122 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:40.387605 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:40.388304 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:40.388768 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:40.389199 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:40.534543 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:40.543453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-b19b4aa0-6b3b-4e0a-97f6-18f33514909f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1359 microversion: 2.1 time: 0.172152 Aug 24 06:52:40.544681 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 441/931] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:40 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:41.568492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:41.569111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:41.576092 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.576580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.577023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.577724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.578185 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.578627 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.727896 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:41.736449 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-60e684d3-b6d7-4b36-a976-1ebd3993d1a7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1549 microversion: 2.1 time: 0.173311 Aug 24 06:52:41.737000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 491/932] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:41 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:41.757832 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:41.758571 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:41.765870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.766365 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.766841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.767569 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.768029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.768490 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.906428 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:41.915570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2a8c78e5-61f8-4694-b5be-b57ab1b7c42b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1549 microversion: 2.1 time: 0.161888 Aug 24 06:52:41.916113 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 442/933] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:41 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:52:41.936105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:41.940863 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:41.941575 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Searching by: {'deleted': False, 'project_id': 'df1bd62253b1499d967691558359d094'} {{(pid=127291) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 06:52:41.948533 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.949003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.949441 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:41.950164 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:41.950616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:41.951037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:42.042371 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.multi_cell_list [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127291) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 06:52:42.140966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5b3a0ec4-e675-49e8-b4aa-ec68e1fcae7b tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209083 Aug 24 06:52:42.141464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 492/934] 10.222.0.52 () {58 vars in 1125 bytes} [Wed Aug 24 06:52:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:42.155846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:42.156621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:42.165805 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:42.166432 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:42.166990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:42.168091 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:42.168771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:42.169398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:42.317680 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:42.325894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e563ac53-4bdd-4660-a8c6-28175ba1eb72 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1549 microversion: 2.1 time: 0.176279 Aug 24 06:52:42.326472 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 443/935] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:42 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:44.092447 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:44.094803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:44.101996 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:44.102491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:44.102982 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:44.103792 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:44.104191 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:44.104633 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:44.370354 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8409a704-7923-427c-929d-5980b6e2bb79 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281687 Aug 24 06:52:44.370993 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 493/936] 10.222.0.52 () {60 vars in 1323 bytes} [Wed Aug 24 06:52:44 2022] POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:50.971849 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:50.972418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:50.979639 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:50.980127 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:50.980565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:50.981264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:50.981719 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:50.982144 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:51.123671 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:51.135864 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4cacf905-ef64-4f48-b0e0-f2fa79dd3e50 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1595 microversion: 2.1 time: 0.167620 Aug 24 06:52:51.136667 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 444/937] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:50 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:53.220234 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:53.228121 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:53.234931 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:53.240399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:53.241020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:53.241535 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:53.248382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:53.258926 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] Creating event network-changed:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:52:53.264630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-a127b1e7-b1d7-4906-a759-6d0dc0a0fb3c req-51a66a56-2117-460b-baa6-6f4966984b53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045616 Aug 24 06:52:53.265748 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 494/938] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:54.319749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-910454063"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:54.320429 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:54.322996 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:54.331282 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:54.338595 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:54.339045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:54.339821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:54.340305 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:54.340714 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:54.345400 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=67 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:54.478363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.network.security_group_api [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Adding security group 400e7cc8-4e5b-474e-b2c1-e830f211cc26 to port 4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c Aug 24 06:52:54.813110 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-84c744b5-c38e-4e4f-a9c7-cd4483f07641 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action" status: 202 len: 0 microversion: 2.1 time: 0.497351 Aug 24 06:52:54.813984 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 445/939] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:52:54 2022] POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:52:54.823878 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:52:54.824580 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:52:54.832215 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:54.832706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:54.833202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:54.833911 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:54.834386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:54.834775 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:55.000882 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:52:55.009944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8c176ed4-d711-481f-8d68-19cf7f1b0292 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1759 microversion: 2.1 time: 0.191586 Aug 24 06:52:55.010609 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 495/940] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:52:54 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:52:55.282045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:52:55.292426 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:52:55.292902 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:52:55.293334 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:52:55.304789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] Creating event network-changed:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:52:55.310818 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-9a0327fa-2f78-464c-87ea-ce345a02d17d req-174183d1-a810-4261-b913-2f34ac299c91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032885 Aug 24 06:52:55.311435 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 446/941] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:18.393968 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:53:18.395018 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 06:53:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:53:18.409320 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:18.411593 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:18.413845 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=3 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:18.415068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=7 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:18.421572 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:18.422064 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:18.422508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:18.423220 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:18.423731 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:18.424197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:18.502643 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-77acd731-3bd9-4f03-9346-b46218baa246 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action" status: 202 len: 0 microversion: 2.1 time: 0.097047 Aug 24 06:53:18.503330 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 496/942] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:53:18 2022] POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:53:18.514202 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:18.515393 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:18.517715 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:18.518364 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=5 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:18.524855 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:18.525351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:18.525866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:18.526762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:18.527453 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:18.527882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:18.679833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:18.689019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-c90f0ad8-b99e-419c-ac07-77136413852e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1751 microversion: 2.1 time: 0.179159 Aug 24 06:53:18.689610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 447/943] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:18 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:19.714514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:19.715386 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:19.722517 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:19.723031 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:19.723608 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:19.724313 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:19.724830 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:19.725282 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:19.892381 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:19.901477 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b193ddd6-7e74-4805-a461-c7275481d136 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.193678 Aug 24 06:53:19.902111 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 497/944] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:19 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:20.931085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:20.931959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:20.939087 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:20.939611 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:20.940045 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:20.940749 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:20.941203 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:20.941631 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:21.092073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:21.100673 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-45072875-a4ec-4c9f-8857-fe43bde5755a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.174462 Aug 24 06:53:21.101276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 448/945] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:20 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:22.126384 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:22.127516 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:22.138685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:22.139574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:22.140310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:22.141476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:22.143094 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:22.143871 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:22.307407 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:22.316831 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c5de0387-2471-448b-9d14-be57d2b42996 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.197001 Aug 24 06:53:22.317406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 498/946] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:22 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:23.344457 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:23.345284 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:23.354770 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:23.355276 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:23.355708 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:23.356398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:23.356845 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:23.357264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:23.512711 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:23.524920 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-97aae6ec-7b26-4ecc-aadd-cffe4e455ff2 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.186865 Aug 24 06:53:23.525522 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 449/947] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:23 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:24.547889 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:24.548606 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:24.557444 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:24.558110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:24.558739 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:24.560093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:24.560783 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:24.561284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:24.720347 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:24.732020 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-8bd6a671-4d27-4bf2-b643-fdafc3787cd4 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.188783 Aug 24 06:53:24.732603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 499/948] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:24 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:25.758634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:25.760125 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:25.772452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.773269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.773992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.774994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.775647 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.776073 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.828536 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:25.829170 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:25.838588 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.839078 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.839692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.840399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.840865 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.841295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.870819 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:53:25.939957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:25.949356 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-0a5ffbc1-0832-408e-b8c3-2dff5ac43cfd tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.197223 Aug 24 06:53:25.954928 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-907afac7-fd78-422d-8077-bf330c743fd5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 204 len: 0 microversion: 2.1 time: 0.131423 Aug 24 06:53:25.955859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 500/949] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:53:25 2022] DELETE /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:53:25.963734 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 450/950] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:25 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:25.964417 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:25.965130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:25.971418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.971906 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.972346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:25.973044 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:25.973504 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:25.973933 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.117000 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:26.131087 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-ee414898-1963-4ac1-9c65-67d35db24b48 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1578 microversion: 2.1 time: 0.170572 Aug 24 06:53:26.132068 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 501/951] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:25 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:53:26.975861 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:26.976869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:26.986615 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.987417 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.988042 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:26.989165 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:26.989803 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:26.990341 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:27.148991 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:27.153666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:27.154253 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:27.158082 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-34ba6041-43ad-4904-b5c1-00c74d11d7b8 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.189132 Aug 24 06:53:27.158637 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 451/952] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:26 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:27.161137 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:27.161622 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:27.162052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:27.162743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:27.163219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:27.163648 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:27.299674 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:27.307942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-db2fa8ae-a408-47c0-8e9f-f7577236a606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1578 microversion: 2.1 time: 0.158369 Aug 24 06:53:27.308512 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 502/953] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:27 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:28.179626 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:28.180239 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:28.187894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.188394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.188833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.189540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.190015 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.190447 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.318655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "710ba31c-fd62-4a0b-ac84-d9b51862b83c", "name": "network-vif-deleted", "tag": "c74c1f51-88a4-4332-bfae-b1e2f3279b3e"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:28.333529 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.334271 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.334954 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.352209 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:28.362896 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-34f4002f-65b3-4a9e-b305-19bf93084591 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.187101 Aug 24 06:53:28.363960 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 452/954] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:28 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:28.369303 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:28.369926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:28.375979 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.376667 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.377285 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.378184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:28.378646 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:28.379079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:28.381376 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] Creating event network-vif-deleted:c74c1f51-88a4-4332-bfae-b1e2f3279b3e for instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c on hv-cinder-85427 Aug 24 06:53:28.389168 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-0752592a-1a5d-4d3f-9473-1a61233fa0bf req-79c48f74-2155-4d64-b8aa-785cfca945de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073770 Aug 24 06:53:28.390413 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 503/955] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:28.467266 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:28.476697 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a0b3dd72-e1cd-47ed-b1ae-692056cc46ba tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 200 len: 1225 microversion: 2.1 time: 0.111855 Aug 24 06:53:28.477485 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 453/956] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:28 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:29.387741 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:29.388426 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:29.395129 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.395661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.396089 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.396800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.397239 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.397658 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.498150 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:29.498820 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:29.505823 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.506309 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.506744 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.507517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:29.507969 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:29.508386 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:29.522580 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] HTTP exception thrown: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Request method failure captured: Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c HTTP/1.1 Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcozn10leSLxDUGi3vQ1X5Bd12GTUc94-StRx9j2WPmh9Q5auXOZNlbukSpi6zC1fdopuWAOuask4H4rfmEUAjoh9xFYxzWUios-qUdw4xIqAVmb1kJQ9NlJjGZiYyebdBFHNAMuq3bZ3Su5Rcx4TOBNQ6kkYadxBK5BgZ66y37tdPs Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:53:29.524269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13dae75bec47489cac0248f2bb2c197d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 0b23553f7543446cb5eca18f26e25816 Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:53:29.525868 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '710ba31c-fd62-4a0b-ac84-d9b51862b83c'} Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:53:29.526746 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:53:29.528789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:53:29.530391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Returning 404 to user: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:53:29.530391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-2db79045-0785-4d42-8909-442ed71da167 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 404 len: 111 microversion: 2.1 time: 0.031654 Aug 24 06:53:29.530391 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 454/957] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:29 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:53:29.560635 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:29.569370 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-71308bef-b45e-4a56-a367-d3778b3da6ad tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.187733 Aug 24 06:53:29.570045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 504/958] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:29 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:29.626217 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-41650543", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1634728052", "security_groups": [{"name": "tempest-secgroup-smoke-1819948811"}], "block_device_mapping_v2": [{"uuid": "c0ee99d7-0985-4d14-9559-a3e99aaf3a6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac79ef75-2295-49c5-bcaa-808b501af7f4"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:29.958910 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] validate_networks() for [('ac79ef75-2295-49c5-bcaa-808b501af7f4', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:53:30.358410 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:53:30.358893 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:53:30.359468 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:53:30.360096 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:53:30.360576 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:53:30.370244 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.370729 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.371158 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.371911 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.372378 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.372785 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.390621 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:53:30.394775 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for user 0b23553f7543446cb5eca18f26e25816 and project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:53:30.454081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:53:30.456234 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0ee99d7-0985-4d14-9559-a3e99aaf3a6f',volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:53:30.592763 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:30.593349 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:30.599919 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.600411 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.600848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.601540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:30.602002 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:30.602429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:30.604992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ebd1b3db-ad26-4d0a-9a13-390f7179642d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982133 Aug 24 06:53:30.611332 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 455/959] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:53:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:53:30.616394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bc48e327-ae9c-4d88-8b8b-1c4f8dbf8d4d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:30.617270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bc48e327-ae9c-4d88-8b8b-1c4f8dbf8d4d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:30.679838 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bc48e327-ae9c-4d88-8b8b-1c4f8dbf8d4d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:30.689159 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bc48e327-ae9c-4d88-8b8b-1c4f8dbf8d4d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1093 microversion: 2.1 time: 0.076527 Aug 24 06:53:30.689753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 456/960] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:30 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:30.831343 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:30.841165 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fbe0c529-02b5-4e4d-adc0-92bde165cd8e tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.253465 Aug 24 06:53:30.841808 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 505/961] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:30 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:31.710253 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:31.710878 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:31.719054 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.719640 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.721074 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.721858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.722330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.722839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.792668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:31.803869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-04cb95ed-8c37-4658-8e74-f6afb507c82e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1209 microversion: 2.1 time: 0.097654 Aug 24 06:53:31.804549 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 457/962] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:31 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1209 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:31.862406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:31.863113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:31.869842 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.870502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.870944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:31.871716 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:31.872171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:31.872603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:32.026461 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:32.036311 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-3d04bb11-4ae7-4043-9ca1-fcec5da2feb0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.178025 Aug 24 06:53:32.036892 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 506/963] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:31 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:32.826198 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:32.826757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:32.833257 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:32.833849 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:32.834359 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:32.835128 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:32.835686 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:32.836184 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:32.974434 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:32.983515 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-1a71de2e-4077-41a0-8a74-b23fa90ea251 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.161512 Aug 24 06:53:32.984149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 458/964] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:32 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:33.058797 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:33.060574 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:33.069361 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:33.069944 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:33.070438 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:33.071226 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:33.071735 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:33.072214 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:33.224265 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:33.228602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee45cee-a4b1-4777-86f8-f23b02b7a717", "tag": "f3d781cc-da3d-46ce-a318-5016c813ab3a"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:33.238603 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:33.239095 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:33.239557 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:33.240399 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a9f52e59-5f0d-4efd-8776-7f13e02de10a tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.186123 Aug 24 06:53:33.240988 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 507/965] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:33 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:33.251905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] Creating event network-changed:f3d781cc-da3d-46ce-a318-5016c813ab3a for instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 on hv-cinder-85427 Aug 24 06:53:33.257804 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-dc8cdbba-9cce-46cb-8ca3-9d0476908989 req-b2467e59-1648-442e-9257-0c790950b3a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037233 Aug 24 06:53:33.258410 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 459/966] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:34.007352 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:34.008373 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:34.018667 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.019225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.019890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:34.021037 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.021713 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.022445 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:34.162406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:34.170879 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-e1b4e4fc-f4e6-4018-ab38-df60d9d6bc18 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.169832 Aug 24 06:53:34.171502 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 508/967] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:33 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:34.262959 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:34.263789 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:34.270355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.270837 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.271302 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:34.271994 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:34.272443 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:34.272866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:34.421295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:34.429782 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d41abb44-6304-4491-aa6d-8dae589bf1c7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1756 microversion: 2.1 time: 0.171777 Aug 24 06:53:34.430353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 460/968] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:34 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:35.193646 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:35.194278 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:35.201717 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.202205 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.202644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.203392 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.203853 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.204279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.345978 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:35.357476 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c7f6e4f2-d374-4909-a558-d94348197b67 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.168554 Aug 24 06:53:35.358309 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 509/969] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:35 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:35.455080 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:35.456053 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:35.466090 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.466602 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.467019 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.467757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:35.468215 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:35.468961 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:35.617616 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:35.626409 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ca646bbc-341c-4ac0-8851-c356ba066f8d tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1759 microversion: 2.1 time: 0.178064 Aug 24 06:53:35.626984 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 461/970] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:35 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:36.380046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:36.380767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:36.389033 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:36.389599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:36.390108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:36.390912 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:36.391492 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:36.391987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:36.412118 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:36.535292 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:36.547036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-21c21664-41da-4223-a3e3-e129e6998de1 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.171591 Aug 24 06:53:36.547665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 510/971] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:36 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:37.578052 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:37.578816 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:37.585950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.586487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.586978 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.587876 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:37.588381 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:37.588850 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:37.731748 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:37.740211 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ae0cb0fb-5946-4953-9d55-bb06c364c408 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.167442 Aug 24 06:53:37.740813 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 462/972] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:37 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:38.765279 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:38.766177 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:38.775872 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.776481 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.777010 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.777884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:38.778465 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:38.778994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:38.919109 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:38.927809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0e8b0e72-d507-495e-919d-c63e997e4bde tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.168988 Aug 24 06:53:38.928395 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 511/973] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:38 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:39.954170 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:39.955263 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:39.965950 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.966431 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.966866 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:39.967581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:39.968016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:39.968441 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:40.118252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:40.127385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-f547f697-f9f0-4de9-ad5e-aeb2e8366357 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.180399 Aug 24 06:53:40.127944 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 463/974] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:39 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:41.152052 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:41.152665 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:41.163471 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.164174 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.164796 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.165893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:41.166495 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:41.167040 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:41.307186 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:41.317692 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d92095dd-4e1f-4a34-8913-961d687c1d43 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.172117 Aug 24 06:53:41.318242 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 512/975] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:41 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:42.346973 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:42.348249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:42.350506 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:42.351182 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=8 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:42.357759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:42.358243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:42.358672 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:42.359624 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:42.360079 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:42.360501 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:42.503103 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:42.511223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5ec4638e-c020-41a4-89e6-dd9ac841cf8f tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.168906 Aug 24 06:53:42.511806 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 464/976] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:42 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:43.532263 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:43.532866 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:43.539999 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:43.540491 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:43.540929 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:43.541620 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:43.542086 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:43.542514 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:43.677770 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:43.685943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c94eec40-bdfd-4421-8de6-7b8fd37969e4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.157683 Aug 24 06:53:43.686523 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 513/977] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:43 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:44.710738 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:44.711689 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:44.722670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:44.723539 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:44.724270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:44.725418 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:44.726246 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:44.726941 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:44.867997 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:44.876031 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-050874c7-268a-4399-8d73-f0203b02a75c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.172018 Aug 24 06:53:44.876606 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 465/978] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:44 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:45.331624 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee45cee-a4b1-4777-86f8-f23b02b7a717", "name": "network-vif-plugged", "status": "completed", "tag": "f3d781cc-da3d-46ce-a318-5016c813ab3a"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:45.342258 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:45.342903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:45.343601 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:45.356334 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] Creating event network-vif-plugged:f3d781cc-da3d-46ce-a318-5016c813ab3a for instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 on hv-cinder-85427 Aug 24 06:53:45.361799 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-968a8438-d2cc-4100-af99-832c59bbc794 req-0447ddc5-8f1a-4ae5-b47d-9da5b7242a5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Aug 24 06:53:45.362798 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 514/979] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:53:45.897484 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:45.898149 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:45.905436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:45.906101 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:45.906740 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:45.907496 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:45.907963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:45.908394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:45.927565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=100 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:46.048678 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:46.057356 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6deff3d7-51fe-4a17-8201-1b23c9564c06 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1265 microversion: 2.1 time: 0.163577 Aug 24 06:53:46.058139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 466/980] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:45 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:47.081664 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:47.083212 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:47.090422 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:47.090915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:47.091394 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:47.092090 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:47.093122 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:47.093658 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:47.241660 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:47.252406 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-cf94d221-95f5-4318-b300-ff29ce5acf1d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1452 microversion: 2.1 time: 0.175628 Aug 24 06:53:47.252986 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 515/981] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:47 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:47.272597 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:53:47.273221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:53:47.280264 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:47.280829 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:47.281328 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:47.282056 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:47.282519 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:47.282951 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:47.419757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:53:47.431915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6b22409c-242e-4e71-97fc-7c9ff6f20968 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1452 microversion: 2.1 time: 0.162851 Aug 24 06:53:47.432565 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 467/982] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:53:47 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:53:49.103640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee45cee-a4b1-4777-86f8-f23b02b7a717", "tag": "f3d781cc-da3d-46ce-a318-5016c813ab3a"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:53:49.109050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:53:49.115630 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:53:49.116158 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:53:49.116601 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:53:49.130254 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] Creating event network-changed:f3d781cc-da3d-46ce-a318-5016c813ab3a for instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 on hv-cinder-85427 Aug 24 06:53:49.135437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-0b664704-35c9-4a08-8f48-b2d9e70c37ef req-8118f862-e7c7-4eb2-a86e-7a8dbf657e6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035845 Aug 24 06:53:49.136387 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 516/983] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:09.093363 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-910454063"}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:09.094382 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:09.097600 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.098300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=8 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.104821 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:09.105441 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:09.105990 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:09.106723 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:09.107401 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:09.107915 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:09.248394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.network.security_group_api [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Removing security group 400e7cc8-4e5b-474e-b2c1-e830f211cc26 from port 4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c Aug 24 06:54:09.577910 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-9758a8e0-a685-45ee-a0da-d5dbea896669 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action" status: 202 len: 0 microversion: 2.1 time: 0.491122 Aug 24 06:54:09.578743 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 468/984] 10.222.0.52 () {60 vars in 1278 bytes} [Wed Aug 24 06:54:09 2022] POST /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:54:09.593661 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:09.610537 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=30 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.611987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.623980 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:09.624462 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:09.624890 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:09.648508 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.compute.server_external_events [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] Creating event network-changed:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:54:09.654110 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [req-6c83c3b5-2f86-453e-99b3-f14d5677fb79 req-14f6af52-cf0d-43d3-acac-6e02cd868679 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064374 Aug 24 06:54:09.662038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 517/985] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:10.731653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:10.732762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:10.739670 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:10.740164 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:10.740651 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:10.741380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:10.741839 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:10.742270 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:10.828385 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.objects.instance [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lazy-loading 'services' on Instance uuid 2b98800a-e40c-4451-ac2e-928cfdb5096d {{(pid=127290) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:54:10.904757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e2b509e1-16a0-4385-a292-de3d7d22ac77 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments/b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577" status: 202 len: 0 microversion: 2.1 time: 0.177396 Aug 24 06:54:10.905429 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 469/986] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:54:10 2022] DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments/b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:54:10.914803 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:10.917338 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:10.924684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:10.925522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:10.926423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:10.927625 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:10.928310 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:10.928749 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:10.961836 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-45d39c97-ce59-4834-ae24-f4fee1400553 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051318 Aug 24 06:54:10.962557 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 518/987] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:54:10 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:11.669908 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:11.680243 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:11.681041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:11.681727 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:11.695406 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] Creating event network-changed:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:54:11.701135 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-e8bf523c-115e-44ef-b506-4bfa39f1c0a2 req-13f329d0-03a8-43f9-99a9-2dc478931d8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034926 Aug 24 06:54:11.702421 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 470/988] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:11.975104 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:11.977464 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:11.984599 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:11.985102 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:11.985543 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:11.986266 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:11.986727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:11.987162 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:12.019782 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-be11db25-90d3-4ca3-bfd6-06c343bdd8d5 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048677 Aug 24 06:54:12.025888 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 519/989] 10.222.0.52 () {58 vars in 1302 bytes} [Wed Aug 24 06:54:11 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:54:12.032340 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:12.032957 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:12.040322 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:12.040894 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:12.041402 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:12.042221 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:12.042747 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:12.043295 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:12.126846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] HTTP exception thrown: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d is not attached to volume b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Request method failure captured: Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments/b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 HTTP/1.1 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcqXoJKobrEUnWXu-0JH7E-y5zMUpr418Os38IF7E4kX8xkT1Kp-JATU5nPEUkGp43zUa4ksPMeEjuVtzTN2t513Wjalv-mnQQGeePA6OKwdkB06pnxxtKNdx7-nc0t7HLIEFATv3DmaijRBfX-clvhLiPVeRncQkeamIzfCk5A0f4M Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: df1bd62253b1499d967691558359d094 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:54:12.129430 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df1bd62253b1499d967691558359d094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df1bd62253b1499d967691558359d094", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df1bd62253b1499d967691558359d094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df1bd62253b1499d967691558359d094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: df1bd62253b1499d967691558359d094 Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestMinimumBasicScenario-1826918311-project Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 6e2a0358c66f47608554ef937ae57e50 Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestMinimumBasicScenario-1826918311-project Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:54:12.131300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d is not attached to volume b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'server_id': '2b98800a-e40c-4451-ac2e-928cfdb5096d', 'id': 'b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577'} Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577. Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:12.132300 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d is not attached to volume b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d is not attached to volume b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:12.133690 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Returning 404 to user: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d is not attached to volume b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:12.135296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-41d031fd-c4f7-4e0a-a6e3-28cc39e36302 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments/b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577" status: 404 len: 154 microversion: 2.1 time: 0.104487 Aug 24 06:54:12.135296 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 471/990] 10.222.0.52 () {58 vars in 1416 bytes} [Wed Aug 24 06:54:12 2022] DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d/os-volume_attachments/b3d17dcc-0c0d-41f5-9ebd-3e1d70fad577 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:54:13.282694 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:13.283257 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:13.290510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:13.291003 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:13.291446 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:13.292190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:13.292984 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:13.293689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:13.324743 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:54:13.406050 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-39c1cb3c-2c6b-472a-ac30-45ab229f81da tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 204 len: 0 microversion: 2.1 time: 0.127057 Aug 24 06:54:13.406964 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 520/991] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:54:13 2022] DELETE /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:54:13.415628 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:13.416258 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:13.422809 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:13.423343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:13.423778 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:13.424473 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:13.424930 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:13.425343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:13.580346 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:13.590105 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-08853d34-cc9c-4237-8432-b2818f1e3cd7 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1555 microversion: 2.1 time: 0.178292 Aug 24 06:54:13.590872 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 472/992] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:13 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:14.616080 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:14.616905 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:14.625600 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:14.626193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:14.626769 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:14.627777 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:14.628389 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:14.628909 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:14.781790 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:14.794576 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-f5c1346e-bc2f-4569-aad7-5302cdcecab0 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1555 microversion: 2.1 time: 0.184051 Aug 24 06:54:14.795385 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 521/993] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:14 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:15.640587 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b98800a-e40c-4451-ac2e-928cfdb5096d", "name": "network-vif-deleted", "tag": "4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:15.655051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:15.655934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:15.656386 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:15.668642 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] Creating event network-vif-deleted:4ee82ac6-db5c-47dd-bb3c-71f70fad1c7c for instance 2b98800a-e40c-4451-ac2e-928cfdb5096d on hv-cinder-85427 Aug 24 06:54:15.673589 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-4d07611e-5f84-48ce-afa1-26b56e00beb4 req-82b83528-9a36-4a84-bb95-84288e9a5f7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106858 Aug 24 06:54:15.674180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 473/994] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:15.819438 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:15.820006 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:15.828666 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:15.829153 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:15.829585 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:15.830382 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:15.830925 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:15.831595 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:15.867706 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:15.868200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:15.868640 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:15.869108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lazy-loading 'fault' on Instance uuid 2b98800a-e40c-4451-ac2e-928cfdb5096d {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:54:15.922684 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e2a0358c66f47608554ef937ae57e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1bd62253b1499d967691558359d094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:54:15.930767 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-359e026b-cd6e-43fb-9bff-3650c9b3951f tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 200 len: 1349 microversion: 2.1 time: 0.115638 Aug 24 06:54:15.931421 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 522/995] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:15 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:54:16.958077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:16.958922 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] [instance: 2b98800a-e40c-4451-ac2e-928cfdb5096d] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:16.966469 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:16.967033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:16.967581 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:16.968383 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:16.968905 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:16.969415 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:16.984999 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] HTTP exception thrown: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Request method failure captured: Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d HTTP/1.1 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcqXoJKobrEUnWXu-0JH7E-y5zMUpr418Os38IF7E4kX8xkT1Kp-JATU5nPEUkGp43zUa4ksPMeEjuVtzTN2t513Wjalv-mnQQGeePA6OKwdkB06pnxxtKNdx7-nc0t7HLIEFATv3DmaijRBfX-clvhLiPVeRncQkeamIzfCk5A0f4M Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: df1bd62253b1499d967691558359d094 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:54:16.986819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df1bd62253b1499d967691558359d094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_df1bd62253b1499d967691558359d094", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/df1bd62253b1499d967691558359d094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/df1bd62253b1499d967691558359d094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: df1bd62253b1499d967691558359d094 Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1826918311 Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestMinimumBasicScenario-1826918311-project Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 6e2a0358c66f47608554ef937ae57e50 Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestMinimumBasicScenario-1826918311-project Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. Aug 24 06:54:16.988625 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '2b98800a-e40c-4451-ac2e-928cfdb5096d'} Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:16.993372 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. Aug 24 06:54:16.995106 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:54:16.996436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Returning 404 to user: Instance 2b98800a-e40c-4451-ac2e-928cfdb5096d could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:16.996436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-ac00b527-bb85-4459-a11b-627d48f270f9 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d" status: 404 len: 111 microversion: 2.1 time: 0.036025 Aug 24 06:54:16.996436 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 474/996] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:54:16 2022] GET /compute/v2.1/servers/2b98800a-e40c-4451-ac2e-928cfdb5096d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:54:16.997903 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-60c7cd19-8706-4acc-adef-3beb62bffc34 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] Calling method '.version_select at 0x7f3dc8990700>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:17.018443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-60c7cd19-8706-4acc-adef-3beb62bffc34 tempest-TestMinimumBasicScenario-1826918311 tempest-TestMinimumBasicScenario-1826918311-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1357987431" status: 202 len: 0 microversion: 2.1 time: 0.024644 Aug 24 06:54:17.019027 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 523/997] 10.222.0.52 () {58 vars in 1272 bytes} [Wed Aug 24 06:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1357987431 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:55:07.617822 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:55:07.619028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 06:55:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:55:35.267041 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=14 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:35.267841 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:35.272012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2120828779", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1634728052", "security_groups": [{"name": "tempest-secgroup-smoke-1819948811"}], "block_device_mapping_v2": [{"uuid": "3d27cf41-2229-41e7-82b0-6da0d06f5c65", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ac79ef75-2295-49c5-bcaa-808b501af7f4"}]}} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:35.400020 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.network.neutron [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] validate_networks() for [('ac79ef75-2295-49c5-bcaa-808b501af7f4', None, None, None, None, None)] {{(pid=127290) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:55:36.084869 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:55:36.085524 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image limits 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:55:36.086294 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Flavor pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:55:36.086934 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Image pref 0:0:0 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:55:36.087659 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.virt.hardware [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127290) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:55:36.101662 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:36.102371 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:36.103009 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:36.104169 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:36.104753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:36.105351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:36.125154 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:55:36.130016 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.quota [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Getting quotas for user 0b23553f7543446cb5eca18f26e25816 and project 13dae75bec47489cac0248f2bb2c197d. Resources: {'cores', 'instances', 'ram'} {{(pid=127290) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:55:36.192904 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Going to run 1 instances... {{(pid=127290) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:55:36.196531 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d27cf41-2229-41e7-82b0-6da0d06f5c65',volume_size=None,volume_type=None)] {{(pid=127290) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:55:36.449423 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-07b63c8e-9858-47cd-8433-1adc5351c76e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.184299 Aug 24 06:55:36.456546 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 475/998] 10.222.0.52 () {60 vars in 1147 bytes} [Wed Aug 24 06:55:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:55:36.459833 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:36.461036 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:36.466057 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-5be5377f-d463-4a34-8d7b-c848b389c4cc tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:36.466676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-5be5377f-d463-4a34-8d7b-c848b389c4cc tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:36.525705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-5be5377f-d463-4a34-8d7b-c848b389c4cc tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:36.536418 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-5be5377f-d463-4a34-8d7b-c848b389c4cc tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1095 microversion: 2.1 time: 0.078309 Aug 24 06:55:36.537296 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 524/999] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:36 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:55:37.568559 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:37.570937 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:37.579515 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.580254 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.581085 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.581975 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.582601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.584077 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.649437 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:37.657857 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4dd44d85-b90f-44d4-8d97-d36593caf7c4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1201 microversion: 2.1 time: 0.094109 Aug 24 06:55:37.658682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 476/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:37 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:55:38.682494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:38.683093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:38.689805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:38.690719 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:38.690869 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:38.691522 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:38.692113 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:38.692560 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:38.834727 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:38.843424 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-c35a1f14-ade8-446c-8e24-1acd4e51bc3d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.168564 Aug 24 06:55:38.846058 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 525/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:38 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:39.046817 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b331a6-2211-49f1-a25a-4f0ab4e24e97", "tag": "7f753638-2785-4b52-9f64-9e1f5fbc9749"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:39.057239 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:39.057805 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:39.058627 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:39.070456 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] Creating event network-changed:7f753638-2785-4b52-9f64-9e1f5fbc9749 for instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 on hv-cinder-85427 Aug 24 06:55:39.075573 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-e5924e72-a94b-4103-9ef4-b1d45dd91314 req-6f2283fc-331c-4fd2-b727-78e6947d4dd3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Aug 24 06:55:39.076162 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 477/1002] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:39.867847 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:39.868443 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:39.875028 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:39.875551 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:39.875987 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:39.876688 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:39.877146 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:39.877614 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:40.016012 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:40.024934 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-d4b013af-0cdd-4a61-84ef-3b9170347e51 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.160737 Aug 24 06:55:40.025423 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 526/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:39 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:41.050882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:41.051753 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:41.062893 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:41.064229 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:41.065355 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:41.066540 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:41.067398 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:41.068076 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:41.207171 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:41.215623 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-a01f76cf-0e98-49dc-ae4f-9e971f14c130 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.171969 Aug 24 06:55:41.216194 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 478/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:41 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:42.239262 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:42.239846 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:42.246611 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:42.247095 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:42.247556 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:42.248250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:42.248707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:42.249130 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:42.405238 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:42.414278 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-96416ada-d02d-4d00-aada-0b71b40b4cf4 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.180316 Aug 24 06:55:42.414821 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 527/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:42 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:43.447388 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:43.448324 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:43.458346 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:43.458858 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:43.459330 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:43.460022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:43.460471 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:43.460897 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:43.609043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:43.617741 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-bcbe5394-26c8-423d-8c76-44099085e606 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.177492 Aug 24 06:55:43.618308 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 479/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:43 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:44.642603 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:44.643427 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:44.653804 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:44.654535 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:44.655246 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:44.656200 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:44.656691 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:44.657321 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:44.806652 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:44.815346 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-45c8afa6-6717-4f6a-91c0-c9dc938af493 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.179001 Aug 24 06:55:44.815915 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 528/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:44 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:45.840307 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:45.841249 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:45.852773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:45.853570 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:45.854343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:45.855541 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:45.856293 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:45.857005 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:45.994343 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:46.005890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-fb380a58-123d-4f18-a62e-9009ab4813f6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.172089 Aug 24 06:55:46.006641 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 480/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:45 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:47.027685 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:47.028293 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:47.030689 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell0:SELECT=2 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:47.036939 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:47.037420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:47.037862 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:47.038566 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:47.039030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:47.039494 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:47.183809 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:47.192513 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a715fc5f-0111-466f-96e2-bc242a0bb075 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.168840 Aug 24 06:55:47.193088 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 529/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:47 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:48.213200 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:48.213799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:48.215833 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=2 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:48.216480 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell0:SELECT=6 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:48.223269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:48.223757 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:48.224252 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:48.224992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:48.225463 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:48.225882 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:48.364012 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:48.373273 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-d14ff2f8-7120-456b-88cc-e254b28b1ecd tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.163999 Aug 24 06:55:48.373906 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 481/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:48 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:49.395901 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:49.396760 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:49.409420 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:49.409902 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:49.410402 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:49.411095 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:49.411586 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:49.411998 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:49.552541 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:49.560837 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-456f231a-b919-443b-bd25-ca64fdef66d0 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.170547 Aug 24 06:55:49.561377 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 530/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:49 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:50.116767 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b331a6-2211-49f1-a25a-4f0ab4e24e97", "name": "network-vif-plugged", "status": "completed", "tag": "7f753638-2785-4b52-9f64-9e1f5fbc9749"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:50.126180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.126653 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.127136 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.138610 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] Creating event network-vif-plugged:7f753638-2785-4b52-9f64-9e1f5fbc9749 for instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 on hv-cinder-85427 Aug 24 06:55:50.144223 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-dfca12f4-7b5f-4c27-8a46-72434d8d2419 req-7066be97-6e79-46bd-89b1-7b5c8a2ae009 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152706 Aug 24 06:55:50.144798 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 482/1012] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:50.582753 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:50.583391 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:50.590305 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.590800 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.591225 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.591977 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:50.592439 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:50.592870 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:50.733425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:50.741619 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b9b16dd4-02a3-4cda-a456-5473ccf04c37 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1267 microversion: 2.1 time: 0.163455 Aug 24 06:55:50.742193 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 531/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:50 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:51.764137 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:51.765634 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:51.772351 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.772845 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.773285 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:51.773992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.774452 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.774879 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:51.915403 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:51.923517 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-e12cb103-6c3d-43dc-9c8b-2ed21189ac9d tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1455 microversion: 2.1 time: 0.164907 Aug 24 06:55:51.924141 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 483/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:51 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:51.946597 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:51.947173 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:51.960105 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.961707 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.962150 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:51.963365 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:51.963829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:51.964250 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:52.110356 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:55:52.119251 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-b77212b2-7d2c-418c-b947-1123dd21fdc7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1455 microversion: 2.1 time: 0.178538 Aug 24 06:55:52.119848 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 532/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:51 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:53.768462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b331a6-2211-49f1-a25a-4f0ab4e24e97", "tag": "7f753638-2785-4b52-9f64-9e1f5fbc9749"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:55:53.778444 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:53.778931 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:53.779406 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:53.791846 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] Creating event network-changed:7f753638-2785-4b52-9f64-9e1f5fbc9749 for instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 on hv-cinder-85427 Aug 24 06:55:53.796733 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-a8b3b8f2-7e62-4fcf-89a5-a4b3d08a0947 req-908878f5-a001-4ad5-a37a-c175effcf47a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031967 Aug 24 06:55:53.797554 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 484/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:38.406380 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:56:38.407554 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 06:56:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:56:53.581030 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:56:53.581966 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 06:56:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:57:19.736273 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:57:19.737209 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 06:57:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:57:27.349499 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_api:SELECT=20 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:27.351219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG dbcounter [-] [127291] Writing DB stats nova_cell1:SELECT=48 {{(pid=127291) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:27.351806 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:27.352700 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG dbcounter [-] [127290] Writing DB stats nova_cell1:SELECT=44 {{(pid=127290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:27.355742 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:27.356202 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:27.357043 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b331a6-2211-49f1-a25a-4f0ab4e24e97", "tag": "7f753638-2785-4b52-9f64-9e1f5fbc9749"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:57:27.365938 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:27.366436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:27.367268 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:27.367867 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:27.368205 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:27.368510 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:27.368643 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:27.369045 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:27.369201 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:27.381907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] Creating event network-changed:7f753638-2785-4b52-9f64-9e1f5fbc9749 for instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 on hv-cinder-85427 Aug 24 06:57:27.387097 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-ba0fca70-d0bb-46a8-ad0c-d46500ccfcda req-f820ad2b-b685-4746-94f5-52cfb6739303 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036875 Aug 24 06:57:27.390926 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 485/1017] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:57:27.401294 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:57:27.500945 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-52b2e861-2d68-4460-9657-a601a7baca83 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 204 len: 0 microversion: 2.1 time: 0.152802 Aug 24 06:57:27.505829 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 533/1018] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:57:27 2022] DELETE /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:57:27.511216 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:27.512104 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:27.518493 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:27.518975 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:27.519439 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:27.520133 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:27.520759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:27.521337 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:27.657172 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:27.665129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-4657acf5-6345-4a70-aacc-aa78841becaf tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1579 microversion: 2.1 time: 0.158110 Aug 24 06:57:27.665675 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 486/1019] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:27 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:57:28.687182 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:28.688616 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:28.695724 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:28.696219 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:28.696656 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:28.697369 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:28.697897 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:28.698284 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:28.837721 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:28.848213 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-83f1a1a8-dd2e-452a-b76d-5a237871fcc6 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1579 microversion: 2.1 time: 0.165731 Aug 24 06:57:28.848705 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 534/1020] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:28 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:29.532793 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b331a6-2211-49f1-a25a-4f0ab4e24e97", "name": "network-vif-deleted", "tag": "7f753638-2785-4b52-9f64-9e1f5fbc9749"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:57:29.543033 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:29.543544 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:29.543971 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:29.555601 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] Creating event network-vif-deleted:7f753638-2785-4b52-9f64-9e1f5fbc9749 for instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 on hv-cinder-85427 Aug 24 06:57:29.560771 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-a4e7e5ed-9abc-4b62-b9cb-7e5df8cbe9de req-a27a2d45-65c9-4b56-9fa4-5c952e360e5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031960 Aug 24 06:57:29.561354 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 487/1021] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:57:29.870192 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:29.870825 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:29.877893 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:29.878289 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:29.878774 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:29.879520 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:29.879994 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:29.880429 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:29.914437 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:29.914943 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:29.915531 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:29.915985 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lazy-loading 'fault' on Instance uuid 58b331a6-2211-49f1-a25a-4f0ab4e24e97 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:57:29.960241 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:29.968448 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-04f28017-fbd7-4d8b-901d-6298cdcbef02 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 200 len: 1231 microversion: 2.1 time: 0.102040 Aug 24 06:57:29.969081 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 535/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:29 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:30.990709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:30.991394 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 58b331a6-2211-49f1-a25a-4f0ab4e24e97] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:30.998057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:30.998538 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:30.998968 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:31.000246 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:31.000706 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:31.001139 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:31.014592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] HTTP exception thrown: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Request method failure captured: Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 HTTP/1.1 Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcozn10leSLxDUGi3vQ1X5Bd12GTUc94-StRx9j2WPmh9Q5auXOZNlbukSpi6zC1fdopuWAOuask4H4rfmEUAjoh9xFYxzWUios-qUdw4xIqAVmb1kJQ9NlJjGZiYyebdBFHNAMuq3bZ3Su5Rcx4TOBNQ6kkYadxBK5BgZ66y37tdPs Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:57:31.016790 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13dae75bec47489cac0248f2bb2c197d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 0b23553f7543446cb5eca18f26e25816 Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. Aug 24 06:57:31.018682 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '58b331a6-2211-49f1-a25a-4f0ab4e24e97'} Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:57:31.019649 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. Aug 24 06:57:31.021242 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:31.022759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Returning 404 to user: Instance 58b331a6-2211-49f1-a25a-4f0ab4e24e97 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:57:31.022759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-beb3959b-ba61-457f-a997-a8a764bbfd0c tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97" status: 404 len: 111 microversion: 2.1 time: 0.032309 Aug 24 06:57:31.022759 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 488/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:30 2022] GET /compute/v2.1/servers/58b331a6-2211-49f1-a25a-4f0ab4e24e97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:57:34.193486 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:34.194108 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:34.195799 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee45cee-a4b1-4777-86f8-f23b02b7a717", "tag": "f3d781cc-da3d-46ce-a318-5016c813ab3a"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:57:34.201038 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:34.201613 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:34.202120 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:34.202922 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:34.203478 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:34.203975 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:34.207136 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:34.207652 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:34.208083 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:34.221788 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] Creating event network-changed:f3d781cc-da3d-46ce-a318-5016c813ab3a for instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 on hv-cinder-85427 Aug 24 06:57:34.227081 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-cb0cd3ff-85dd-4006-8de7-1f63b66525ea req-4d66b5cb-724c-4f8a-a851-577f19b74bff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035372 Aug 24 06:57:34.227709 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 489/1024] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:57:34.236641 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Going to try to terminate instance {{(pid=127291) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:57:34.335859 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-0c17c1d7-0247-4aba-8827-20d53b0a21e5 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 204 len: 0 microversion: 2.1 time: 0.145664 Aug 24 06:57:34.336425 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 536/1025] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:57:34 2022] DELETE /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:57:34.345124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:34.346051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:34.353269 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:34.354022 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:34.354668 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:34.355424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:34.356057 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:34.356487 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:34.494433 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.policy [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127290) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:34.504592 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-537ab0f7-0f3c-46d7-a44f-2bcd81860845 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1577 microversion: 2.1 time: 0.163932 Aug 24 06:57:34.505234 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 490/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:34 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:35.526672 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:35.527473 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:35.534490 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:35.534989 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:35.535479 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:35.536190 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:35.536662 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:35.537084 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:35.679561 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:35.687805 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-bbf945d6-e933-4d05-b71a-a05bdcc5406a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1577 microversion: 2.1 time: 0.165522 Aug 24 06:57:35.688419 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 537/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:35 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:36.274842 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee45cee-a4b1-4777-86f8-f23b02b7a717", "name": "network-vif-deleted", "tag": "f3d781cc-da3d-46ce-a318-5016c813ab3a"}]} {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:57:36.284786 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:36.285261 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:36.285687 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:36.297167 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.compute.server_external_events [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] Creating event network-vif-deleted:f3d781cc-da3d-46ce-a318-5016c813ab3a for instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 on hv-cinder-85427 Aug 24 06:57:36.302332 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [req-3b4e97bb-cefb-4925-96d6-810d28d5b919 req-f8a2e848-83ba-4c00-afcd-021f031b1ea9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031497 Aug 24 06:57:36.302999 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 491/1028] 10.222.0.52 () {64 vars in 1317 bytes} [Wed Aug 24 06:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:57:36.708436 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:36.709048 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:36.715644 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:36.716148 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:36.716592 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:36.717290 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:36.717745 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:36.718171 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:36.750722 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:36.751178 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:36.751676 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:36.752126 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.objects.instance [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lazy-loading 'fault' on Instance uuid 3ee45cee-a4b1-4777-86f8-f23b02b7a717 {{(pid=127291) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:57:36.800655 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.policy [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b23553f7543446cb5eca18f26e25816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13dae75bec47489cac0248f2bb2c197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127291) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:57:36.809023 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-fcf09ded-221c-4e37-aaf0-e1dd486aaeb7 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 200 len: 1229 microversion: 2.1 time: 0.104554 Aug 24 06:57:36.809578 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 538/1029] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:36 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:57:37.834006 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:37.834819 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 3ee45cee-a4b1-4777-86f8-f23b02b7a717] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:37.842424 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:37.842963 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:37.843497 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:37.844268 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:37.844773 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:37.845255 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:37.864462 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] HTTP exception thrown: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Request method failure captured: Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 HTTP/1.1 Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcozn10leSLxDUGi3vQ1X5Bd12GTUc94-StRx9j2WPmh9Q5auXOZNlbukSpi6zC1fdopuWAOuask4H4rfmEUAjoh9xFYxzWUios-qUdw4xIqAVmb1kJQ9NlJjGZiYyebdBFHNAMuq3bZ3Su5Rcx4TOBNQ6kkYadxBK5BgZ66y37tdPs Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:57:37.866126 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13dae75bec47489cac0248f2bb2c197d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 0b23553f7543446cb5eca18f26e25816 Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. Aug 24 06:57:37.867993 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '3ee45cee-a4b1-4777-86f8-f23b02b7a717'} Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:57:37.869051 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. Aug 24 06:57:37.870459 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:37.871762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Returning 404 to user: Instance 3ee45cee-a4b1-4777-86f8-f23b02b7a717 could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:57:37.871762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-5505089f-2fc3-4955-97d4-a3f0f08e2f9a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717" status: 404 len: 111 microversion: 2.1 time: 0.039637 Aug 24 06:57:37.871762 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 492/1030] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:37 2022] GET /compute/v2.1/servers/3ee45cee-a4b1-4777-86f8-f23b02b7a717 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:57:38.373542 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:38.374093 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.compute.api [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127291) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:38.381197 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:38.381693 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:38.382133 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:38.382835 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:38.383327 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:38.383759 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG oslo_concurrency.lockutils [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127291) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:38.397703 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.wsgi [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] HTTP exception thrown: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Request method failure captured: Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: request: DELETE /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c HTTP/1.1 Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept: application/json Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Accept-Encoding: identity Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Connection: close Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Length: 0 Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Content-Type: application/json Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Host: 10.222.0.52 Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Openstack-System-Scope: None Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: User-Agent: python-urllib3/1.26.11 Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Auth-Token: gAAAAABjBcozn10leSLxDUGi3vQ1X5Bd12GTUc94-StRx9j2WPmh9Q5auXOZNlbukSpi6zC1fdopuWAOuask4H4rfmEUAjoh9xFYxzWUios-qUdw4xIqAVmb1kJQ9NlJjGZiYyebdBFHNAMuq3bZ3Su5Rcx4TOBNQ6kkYadxBK5BgZ66y37tdPs Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Id: None Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Domain-Name: None Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Identity-Status: Confirmed Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Is-Admin-Project: True Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Id: default Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Domain-Name: Default Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Project-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Role: member,reader Aug 24 06:57:38.399401 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Roles: member,reader Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13dae75bec47489cac0248f2bb2c197d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-Tenant-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Id: default Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Domain-Name: Default Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Id: 0b23553f7543446cb5eca18f26e25816 Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: X-User-Name: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: method: > Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: exception: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.401203 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: action_args: {'id': '710ba31c-fd62-4a0b-ac84-d9b51862b83c'} Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:57:38.402295 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.403884 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.405451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Returning 404 to user: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. {{(pid=127291) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:57:38.405451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-1ff63cb9-a9c5-48b2-8904-9f25db64896e tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 404 len: 111 microversion: 2.1 time: 0.031261 Aug 24 06:57:38.405451 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 539/1031] 10.222.0.52 () {58 vars in 1239 bytes} [Wed Aug 24 06:57:38 2022] DELETE /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:57:38.412124 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '>' {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:38.412923 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.compute.api [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] [instance: 710ba31c-fd62-4a0b-ac84-d9b51862b83c] Fetching instance by UUID {{(pid=127290) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:57:38.421713 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:38.422406 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:38.422992 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:38.424560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Acquiring lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:57:38.425029 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:57:38.425455 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG oslo_concurrency.lockutils [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Lock "eb76b9b5-6f0e-42b0-ae34-6cec2ed2de66" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:57:38.440482 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.wsgi [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] HTTP exception thrown: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Request method failure captured: Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: request: GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c HTTP/1.1 Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept: application/json Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Accept-Encoding: identity Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Connection: close Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Length: 0 Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Content-Type: application/json Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Host: 10.222.0.52 Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Openstack-System-Scope: None Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: User-Agent: python-urllib3/1.26.11 Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Auth-Token: gAAAAABjBcozn10leSLxDUGi3vQ1X5Bd12GTUc94-StRx9j2WPmh9Q5auXOZNlbukSpi6zC1fdopuWAOuask4H4rfmEUAjoh9xFYxzWUios-qUdw4xIqAVmb1kJQ9NlJjGZiYyebdBFHNAMuq3bZ3Su5Rcx4TOBNQ6kkYadxBK5BgZ66y37tdPs Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Id: None Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Domain-Name: None Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Identity-Status: Confirmed Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Is-Admin-Project: True Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Id: default Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Domain-Name: Default Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Project-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Role: member,reader Aug 24 06:57:38.442004 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Roles: member,reader Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_13dae75bec47489cac0248f2bb2c197d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/13dae75bec47489cac0248f2bb2c197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Id: 13dae75bec47489cac0248f2bb2c197d Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-Tenant-Name: tempest-TestVolumeBootPattern-1377963060 Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Id: default Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Domain-Name: Default Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Id: 0b23553f7543446cb5eca18f26e25816 Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: X-User-Name: tempest-TestVolumeBootPattern-1377963060-project Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: method: > Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: exception: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.443912 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: action_args: {'id': '710ba31c-fd62-4a0b-ac84-d9b51862b83c'} Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: {{(pid=127290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:57:38.444870 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. Aug 24 06:57:38.446560 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: ERROR nova.api.openstack.wsgi Aug 24 06:57:38.448353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: DEBUG nova.api.openstack.wsgi [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Returning 404 to user: Instance 710ba31c-fd62-4a0b-ac84-d9b51862b83c could not be found. {{(pid=127290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:57:38.448353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO nova.api.openstack.requestlog [None req-6c45d944-70b2-4384-bceb-2bd667784494 tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c" status: 404 len: 111 microversion: 2.1 time: 0.037720 Aug 24 06:57:38.448353 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: [pid: 127290|app: 0|req: 493/1032] 10.222.0.52 () {58 vars in 1236 bytes} [Wed Aug 24 06:57:38 2022] GET /compute/v2.1/servers/710ba31c-fd62-4a0b-ac84-d9b51862b83c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:57:39.776144 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: DEBUG nova.api.openstack.wsgi [None req-a662c799-c02e-477c-824c-4f064e9e911a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] Calling method '.version_select at 0x7f3dc87a3940>' {{(pid=127291) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:57:39.802357 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO nova.api.openstack.requestlog [None req-a662c799-c02e-477c-824c-4f064e9e911a tempest-TestVolumeBootPattern-1377963060 tempest-TestVolumeBootPattern-1377963060-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1634728052" status: 202 len: 0 microversion: 2.1 time: 0.030091 Aug 24 06:57:39.803581 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: [pid: 127291|app: 0|req: 540/1033] 10.222.0.52 () {58 vars in 1263 bytes} [Wed Aug 24 06:57:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1634728052 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:58:27.631995 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:58:27.632942 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 06:58:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:58:31.956907 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:58:31.957890 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 06:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:59:58.418810 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:59:58.420180 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 06:59:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:00:13.592581 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:00:13.593584 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 07:00:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:00:30.713129 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:00:30.714039 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 07:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:00:39.751004 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:00:39.752046 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 07:00:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:47.643540 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:47.644314 dv-cinder-854271-1-iscsi devstack@n-api.service[127291]: Wed Aug 24 07:01:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:51.970030 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:51.971067 dv-cinder-854271-1-iscsi devstack@n-api.service[127290]: Wed Aug 24 07:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!